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Preface 


This volume is the second to be devoted to the problems of economic 
analysis of the new educational media. It reviews the work done 
between 1976 and 1978 under the medium-term programme approved 
by the General Conference of Unesco at its nineteenth session (Nairobi), 
which provides for assistance to Member States in determining the part 
played by new educational technologies in formal and non-formal edu- 
cation and measuring their cost effectiveness. 

During the first stage of this programme, methods of analysing the 
costs of media with a view to international comparability were promoted 
by the Secretariat in close co-operation with the International Council 
for Educational Media (ICEM) and with assistance from the Institut de 
Recherche sur Économie de l'Éducation (IREDU), Dijon, France. Two 
meetings of experts were held in Paris in 1975 to try to develop a method 
of cost analysis and propose comparable units of measurement. The 
results of these meetings led to an initial publication, The Economics of 
New Educational Media, Vol. 1: Present Status of Research and Trends (Unesco, 
1977). They were also examined at a conference of research workers 
specializing in economic analysis applied to the media which was held 
in Washington, D.C., in 1977. This conference was organized jointly by 
ICEM and the firm, EDUTEL Communication and Development, with 
the help of Unesco and the United States Agency for International Devel- 
opment (USAID). The years 1976, 1977 and 1978 constituted a test 
period during which a number of case-studies were carried out jointly 
by Unesco and the International Bank for Reconstruction and Devel- 
opment (IBRD). These studies, together with the methodological con- 
siderations to which they gave rise, were examined in June 1978 at a 


conference organized in Dijon by the French National Commission for 
Unesco and the University of Dijon, with the help of Unesco, IBRD, 
ICEM and USAID. The theme of this conference was ‘Economic analysis, 
a decisive factor in educational technology’. 

The main papers submitted and discussed at these last two confer- 
ences are given in this volume, which consists of six parts. 

The first part, in which results and problems are reviewed, opens 
with a comprehensive survey by Professor Jean-Claude Eicher summing 
up the studies undertaken since 1975 in regard to the analysis of costs 
and effectiveness; the second part comprises the case-studies made under 
the aegis of Unesco, USAID, IBRD and ICEM; the third contains 
abstracts of certain very recent studies which will be published separ- 
ately; the fourth consists of the reports of the Washington, D.C., and 
Dijon conferences; the fifth an updated version of the world directory of 
specialized institutions and experts published in the preceding volume, 
and a supplement to the international list of studies on the economics of 
the new educational media; and the last part includes a bibliography 
which supplements the list of studies included in the preceding volume. 

The designations employed and the presentation of material 
throughout the publication do not imply the expression of any opinion 
whatsoever on the part of Unesco concerning the legal status of any 
country, territory, city or area or of its authorities, or concerning the 
delimitation of its frontiers or boundaries. In addition, the authors are 
responsible for the choice and the presentation of the facts contained in 
this publication and for the opinions expressed therein, which are not 
necessarily those of Unesco and do not commit the Organization. 
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Results and problems 


Some thoughts on the economic analysis 
of new educational media 


Jean-Claude Eicher 


‘Official’ teaching has traditionally taken the form of direct contact 
between the teacher and a certain number of students. Nevertheless, 
there have been other forms of learning which, in some cases, have 
lasted a long time. After printing was discovered, and especially after the 
price of printing paper dropped in the nineteenth century, some people 
were able to teach themselves; but few possessed the degree of intelligence 
and tenacity required for this solitary effort. More recently, the devel- 
opment of the means of communication has given birth to teaching by 
correspondence and radio. However, these educational techniques have 
remained marginal. 

The enormous growth in the demand for education over the past 
thirty years has forced us to take a fresh look at this problem. In fact, in 
most countries, governments, as well as those responsible for educational 
systems, first tried to satisfy this need by increasing the availability of 
traditional education. For this reason, between 1960 and 1965, the elas- 
ticity of public expenditure on education throughout the world went up 
to 2 and the percentage of the gross national product (GNP) spent on 
education increased from 3.78 to 4.90. 

Most countries, however, began to lag behind in this endeavour, so 
that today we find two disturbing phenomena. 
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In developed countries, the elasticity of public expenditure on ol 
cation in relation to the GNP has fallen back to 1 since the peo 
the 1970s and, in many countries, the education budget is —— 
increasing at all in real terms. Education has thus ceased to be me : 
as a priority item by national authorities. However, the deman a 
young people is, in general, continuing to increase and adults are m 
and more interested in further education. : 4 

In developing countries, the tremendous effort which has been o 
has not, in most cases, succeeded in eradicating illiteracy. In 1974, t 
gross enrolment at primary level was still below 60 per cent in Lo wwe 
countries and in nine of them it was less than 25 per cent; and this takes 
no account of adults. There are also clear signs of a growing incapacity 
to bear the financial burden and of growing dissatisfaction with the 
outcome. The elasticity of public expenditure on education in Telamon 
to the GNP, while remaining clearly higher than 1, has Seta 
considerably in comparison with the preceding decade; doubts about t : 
effectiveness of this effort are growing with the rise in unemploymen 
among graduates. a 

It is, therefore, only natural that the possibility of satisfying tiese 
immense needs by solutions other than ‘traditional schooling should be 
examined. The fact that technical progress has increased the capacity 
for transmission of all kinds of information over a distance has naturally 
directed research towards those systems which make use of the various 
media. 

Examination by economists of the comparative cost structure has 
strengthened this trend, since it has led to a belief that educational 
methods using modern technological materials must normally have fixe 
costs proportionally higher than those of traditional education an 
consequently that they could lead to much bigger economies of scale. . 

It has, thus, very quickly become apparent that economic anay 
could and should help throw light on the problems that educationa 


planning faces today, by systematically comparing the cost and the 
effectiveness of the various solutions. 


Such economic studies were at first 
allow useful comparisons 


to locate where differences of 
basic questions brought up b 
For purely didactic reasons, 


we will successively examine costs and 
benefits and then compare the t 


Wo. 
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Observation and measurement of costs 


Since educational systems using modern technological media are in 
general quite complicated to organize, it is essential first to reach agree- 
ment on what is to be measured and thus the different types of costs to 
be ascertained. 

In so far as studies which are comparable from this point of view 
exist, we can try to draw conclusions from the results. 


Definitions and methods of measuring costs 


There has been considerable progress in this field. First, following the 

meeting of a group of experts in Paris in 1976 and another group of 

experts in Washington, D.C., in 1977, agreement seems to have been 

reached on the following points: 

Studies must endeavour to start with a technical classification of costs in 
four categories: general administration, production, diffusion and usc. 

In each of these categories, it is essential, from an economic point of 
view, to distinguish between fixed and variable costs. 

In general, besides the total cost, it is important to calculate an average 
cost (based on an appropriate criterion) and a marginal cost. 
Costs by each category of operation must also be subdivided according 

to the source of the financing. 


"TABLE 1. Classification of costs 


Economic costs Financial costs 


Technical costs 


according to the size 


(by contributor) 


of operation 
General administration Fixed Ree eom era authority 
Wnrinble Investment Users 
A Recurrent Others 
A " Investment Educational authority 
Production Fixed { Recurrent Community 
Variabl Investment Users 
auae ( Recurrent Others 
. S Investment Educational authorit 
Diffusion? Fixed { Recurrent Community 
s; Investment Users 
Variable Recurrent Others 
K Investment Educational authorit: 
Use Fixed Recurrent Community j 
Variable { Investment Users 
Recurrent Others 


1. According to situation: transmission if radio; reproduction and distribution if it concerns printed 
documents; duplication and circulation if it concerns films, tapes, etc. 
ee ee —————————————————— MM 
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The majority of studies conducted over the past two years have in fact 
followed these rules when possible, thus making their interpretation and 
comparison much easier and more fruitful. 

Serious problems none the less remain. 

Some are due to the nature of the subject under study. In essence, 
the problems relate to measurement of the cost of using existing facilities 
and to the choice of a reference unit for the computation of average cost. 

In the first case, the problem is of a practical nature because, in 
theory, everybody seems to agree on the necessity of measuring this cost 
like all the others. 

In the second, there is a problem in so far as most of the costs vary 
according to the number of users and the length of use of the media but 
are not subject to the same rules, so that the cost is sometimes calculated 


per student and sometimes per hour. The solution that is being increas- 
ingly adopted is to calculate cost per student-hour. - 

Other problems are more closely linked to economic analysis in 
general. 

We will single out the two which seem the most serious, the first 
being that of opportunity cost. The theoretical problem is well known. 
When a given economic activity requires not only the use of scarce 
resources, which means an expenditure for the person who undertakes 
it, but also the rej 


n one case, existing resources are 
the Opportunity to create new assets 1$ 

For the op 
rejected, that is, a 
fore be solved in 


is particularly i i 
pa ticularly arning systems are compared with 
traditional schools. The former are o i a 


Y more advantages 
order to measure dud activity to be reconciled ls 
What the students would canta, 3 advantage one must know ex2^ 
y 


S 
: ey did n «ts. not alway’ 
Finally, Son emild stir ange Which is no 


: and perhaps ify the comparison. € 

Heston ofthe optimal er nae Tious, this arpa raises ia 
: ista 

traditi educational system. If di 1 

d Schooling, why not have it general 4 
Taditional schooling? This touches 


more Se 
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heart of the problem of the comparability of the observed groups, to 
which we will revert in greater detail later on. 

The second problem is that of the interest rate. 

Again, in principle, the theory seems clear and accepted by all 
specialists. Investment creates capital which normally remains pro- 
ductive over a period of years, thereby freezing assets that might have 
been used to produce something else. It is necessary, therefore, to take 
capital productivity into account by adding to the annual amortization a 
sum corresponding to the rate of profit which has been renounced. In fact, 
this procedure is neither so easy to apply nor as clear-cut as it may seem. 

First, it is important to distinguish between the annualization pro- 
cess, which consists in distributing the value of the investment over the 
presumed number of years of usage, and the use of an interest rate. The 
first procedure has only a practical goal, at least in theory—that of 
making the costs for one period correspond with the services rendered 
by the capital for that same period. For example, it would be absurd to 
apply the total cost of a building to the year of its construction. 

Conversely, the use of an interest rate rests on an hypothesis that is 
neither clear nor indisputable. The reason often given is that interest 
might have been obtained by lending the funds instead of using them 
for the purchase of a building or equipment. However, this argument is 
not an explanation and its validity can easily be challenged in so far as it 
is not based on an economic theory. By itself, it consists of equating to a 
loss to the community or at least to the person acting in its name what 
the cost of rejection represents for one individual. As it is difficult to 
imagine a minister of education having a choice between spending his 
construction budget and lending it to a bank, it has to be assumed that 
the opportunity cost is zero. 

If we go further and refer to the theories of interest, we find that, 
roughly speaking, they are of two types: those that put the emphasis on 
the supply side, the so-called ‘loanable’ funds theories which are based 
on the notion of preference for the present; and those that stem from 
demand and are based on the hypothesis of capital productivity. Only 
in capitalist economies where perfect competition existed would the 
confrontation of supply and demand give rise to a price of capital that 
would be ‘the’ interest rate. 

However, capital markets are at best very imperfect and the concept 
of a social discount rate that could be derived from time preference on 
the part of the community is very vague. 

This being so, it could seem that the conclusions to be found in 
many documents to the effect that (a) a positive rate of interest must be 
used; (b) 7.5 per cent appears to be a reasonable rate, do not rest on 
sound theoretical bases. On the one hand, nobody knows the actual time 
preference rate of the community and, on the other, one is not entitled 
to use for other various situations and types of communities a procedure 
that is fully justified only in a competitive capitalist economy. 
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Results of evaluations 


As the number of studies using a comparable methodology increases, Pur 

majority of experts have reached agreement on the following debts die 

The cost structure of distance education systems differs considerably 
from that of traditional Systems; investment and fixed costs are 
higher and operating costs are generally lower. : 

The production costs of audio-visual educational programmes are, in 
general, much higher than the transmission and utilization Y 
especially when it is possible to use an existing broadcasting network. 

The economies of scale are very high in systems using mainly radio, 
television or computers; the marginal costs are thus very low even 
when there are a large number of students. 

For all sizes of operation, the costs for Systems using television are from 
three to ten times higher than for Systems using radio, and the costs 
of computer-assisted learning systems are from ten to fifty times 
higher than those of Systems using television. 


Two other provisional conclusions may also be encountered, although 
expressed in much more cautious terms: 


This cost may even sometim 
traditional systems, 
These conclusions are muc 


in public education due to the opposition of 
the teachers’ unions, 
A suffici 


ucational message’ is print and not 
modern technology, g P 
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A word must nevertheless be said about the shortcomings which studies 
on the cost of educational technologies frequently suffer from and which 
are liable to bias comparisons in favour of such technologies. 

These shortcomings are as follows: 

Because these experiences are fairly new, cost studies are often based on 
evaluations made before the project has actually been implemented, 
although it is a well-known fact that these costs are always under- 
estimated, sometimes to a considerable degree. The latest example 
of this type of error is the Plato IV computerized educational system 
of the University of Illinois in the United States estimated first at 
$1 per student-hour and today at $5. 

Studies often tend to omit the cost of the use of existing infrastructure, 
like State radio and television, since no expenditure is charged to 
the project. 

Studies tend to overlook or underestimate the costs which correspond to 
new activities and which are, therefore, less easy to determine. 
Since, by definition, traditional systems have been in operation for a 
long time and the different elements of their cost are well known, any 
comparison tends to favour artificially the systems using media and it is 


important to be very careful in evaluating them. 
Finally, it must be noted that the results of cost studies conducted 


so far reveal considerable differences between one experiment and 
another. Thus, in the four educational television experiments mentioned 
by Jamison and McAnany,? the student-hour cost varies from $0.575 
to $0.084, i.e. from one to seven, and in the four radio educational 
experiments from $0.018 to $0.331, i.e. from one to eighteen. It can 
therefore be seen that each experiment .has its unique characteristics 
and it is dangerous to come up with an average and to draw specific 
conclusions from it. 

To conclude this review of established facts and problems, it is fair 
to say that cost studies have progressed both in number and in quality 
and that the lessons which can be learned from them are interesting. 
However, we are far from having amassed complete and appropriate 
information and we must not only continue to measure costs, but also, 
as Leslie Wagner strongly suggests, pass on from estimating to analysing 
cost functions which is the only procedure that can help in coming to 


a decision. 


1. We here take up some arguments developed by Martin Carnoy and Henry Levin, 
‘Evaluation of Educational Media: Some Issues’, Instructional Science, No. 4, 1975, 


p. 385-406. : à 
2. D. T. Jamison and E. G. McAnany, Radio Jor Education and Development, Beverly 


Hills/London, Sage Publications, 1978. 
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Definition and measurement of benefits 


The situation is less satisfactory with regard to the study of benefits. The 
cost comparison of two alternative solutions to the same problem is 
obviously insufficient by itself to determine which one to choose, unless 
we are assured that their results are identical. In all other cases, it is 
the net summary of the costs and benefits that should influence the 
decision. 

An analysis of benefits is therefore indispensable in most cases. When 
one studies economic activities on the market, one is interested in the 
benefits measured by the market, i.e. the profits. In the case of edu- 
cational systems, on the contrary, a broader definition of bencfits—and 


not only monetary ones—is chosen and one usually speaks in terms of 
effectiveness. 
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having studied through distance education succeed just as well or better 
than those having completed the same programme in a traditional school. 

There is doubt about the rate of drop-outs and repeaters. We do 
not have enough data on this problem to draw conclusions. It would 
therefore be very useful if, as of now, effectiveness studies attempted to 
gather this information. 

The controversy concerns the effectiveness of multi-media systems 
as compared with single-medium systems. 

Some authors feel that the use of a combination of media in a 
system always brings results superior to those reached by single-medium 
systems. In particular, such is the conclusion reached by Tony Bates.! 

Others, however, such as Jamison and McAnany,? conclude that an 
analysis of results shows that students learn effectively through any 
medium properly used. 

These results, though still incomplete and uncertain are, at first 
glance, encouraging; but careful examination of their meaning shows 


that they must be used with great caution. 


Ambiguity and shortcomings of effectiveness indices 


Three levels must be considered. The first and most obvious is the 
technical level: the indices used are imperfect. The second is that of the 
comparability of situations that must be assumed in order to interpret 
the measurement. The third concerns the objectives of the educational 
systems and leads to a discussion of the relevance of a measurement of 


instructional effectiveness. 


Technical shortcomings i . 
Even if one admits that a measurement of instructional effectiveness is 


useful to the planner, it has to be acknowledged that the measurements 


made so far are inadequate. 

When studying primar 
observe simultaneously the 
cycle and the percentage of students 
time'. As we have already seen, however, 


always observed in the studies available. : 
In post-secondary education, the general analytical and synthesizing 


skills acquired are morc difficult to measure. Evaluation in the conven- 
tional system is traditionally of a subjective nature with the scope of 
standardized tests useful for comparative purposes being very limited.? 


y and secondary education, it is necessary to 
level of knowledge acquired at the end of a 
who reach this level in ‘normal 
this second condition is not 


1. Tony Bates, ‘Options for Delivery Media’, in H. Perraton (ed.), Distance Teaching 
for Formal Education, prepared by the International Extension College for the World 
Bank. 


2. Jamison and McAnany, op. cit. i 
3. ‘Leslie Wagner, study published in this volume, page 225. 
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Problem of comparability 

In order to interpret test results directly, we must assume that ‘all other 
things are equal’. Ideally, we would be concerned with the same popu- 
lation, some of whom would have followed traditional education and 
others distance education. 

This situation is, in fact, rare. In almost all cases, a distance edu- 
cation system has been established precisely because there was a group 
that could not be reached by traditional teaching, whether for reasons of 
distance (scattered populations in out-of-the-way areas, for example) or 
because the students could not spend a full day in school (young adults 
already engaged in active life and not having been able to attend school 
at the normal age, for example). 

Consequently, and even if one is satisfied with comparing traditional 
schooling with the use of media for immediately educational goals,! one 
cannot unambiguously conclude that the system giving the best test 
results is more effective, because we do not know how the population 
using the one system would have reacted in the other. 

Let us take a concrete example to illustrate this: the study of a 
secondary-level educational system using correspondence and radio, 
established in the Republic of Korea in 1974. A detailed analysis of the 


effectiveness of this system has been conducted by the authors of this 
study. This shows that: 


ia are, On average, three to 
Oar m ha S : : 
origins appear to be much more modes ve a job; (c) their social 


every evening between 10,00 and 
g . 0. i ions; 
(c) contacts with teachers take place ery other din On the stations 


not overlook. For a soun n 
Jamison and McAnany, o . ci Various aspects of the toblem aen 
y; Op. cit. P : 
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average high-school student. Indeed, to be willing, although in employ- 
ment, to listen to broadcast lessons so early in the morning and so late 
at night and to sacrifice one Sunday out of two to meet the teachers, a 
student must necessarily be more highly motivated than the average 
secondary school pupil. 

Consequently, the main issue is the following: to what extent are 
those superior results due to the system and to what extent are they due 
to the student? In other words, what assurance have we that the students 
who persevere in a distance-education programme would not succeed 
even better—bearing in mind their strong motivation—in a traditional 
system if they were given financial support to attend classes? 

We must thus be very careful not to confuse scholastic success with 
the effectiveness of the institution. 


Instructional effectiveness and effects of education 
Acquisition of knowledge is not the sole aim or the sole result of school 


attendance beyond the mandatory number of years and especially at the 

post-secondary level. 

To mention only the main ‘services’, it is fair to say that the uni- 
versity offers the student: 

The opportunity to associate with friends and professors, to get to know 
people who will help his career and perhaps cven to sec his life 
transformed by contacts with highly educated people. 

The opportunity to obtain a degree which could in turn influence a 
prospective employer. 

The opportunity to spend a few years more pleasantly than would 
perhaps have been possible if he had accepted a less qualified and 
relatively low-paid job, and this probably at a lower cost thanks to 
grants available for higher education. 

The opportunity to acquire useful knowledge. 

Evaluations of the effectiveness of educational systems, however, usually 

consider only the last of these points. This is especially disturbing when 

we remember that two conclusions are now generally accepted: 

Groups who participate in distance-education programmes have as their 
first, and sometimes sole objective, the desire to acquire a means 
(generally a certificate) of improving their material and professional 
situations. 

The correlation between level of education and level of earning which is 
almost universally observed seems only partially due to the acqui- 
sition of knowledge. 

Inasmuch as the prestige aspect of a certificate predominates, it is 

essential to ensure that certificates issued by distance-teaching systems 

have, in the eyes of potential employers, as much value as the certificates 
issued by traditional institutions, particularly the more distinguished 


ng them. ‘ n : 
EK Finally it is not necessary to emphasize how ridiculous an evaluation 
> 
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of instructional effectiveness would be were the prevailing role of social 
and/or racial origin in professional success demonstrable. 

The measurements of effectiveness currently used in the area of edu- 
cational technology are, therefore, inadequate and must be improved. 
But the comparison of cost and effectiveness presents some other problems. 


Problems of cost-effectiveness analysis 


The principle of cost-effectiveness analysis is the same as that of cost- 
benefit analysis and is well known. The aim is to prepare an accurate state- 
ment of the sacrifices and the benefits involved in alternative decisions so 
as to permit the choice of the one offering the biggest net advantage. 

The use of this technique, however, in the case which concerns 
us—the choice of an educational system—poses two types of problem. In 
view of their complexity, we will state them briefly here. 

First, there is the problem of cost-effectiveness analysis as opposed to 
cost-benefit analysis. Second, there is the problem of using the results for 
educational planning. 


Limits of cost-effectiveness analysis 


Cost-benefit analys) ; 
Th net wd should result in the establishment of a precise index. 


ie because such an analysis works with vari an 
riables that € 

be measured by the same standard: 
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If the cost and effectiveness of A are both.10 per cent lower than B, 
however, it is wholly impossible to conclude that both solutions are 
absolutely equivalent. 

Cost-effectiveness analysis therefore only provides information that 
must be evaluated by the decision-maker; it does not provide objective and 
definite criteria of choice. 


Cost-effectiveness analysis and educational planning 


| Cost-effectiveness analysis is based on the observation of existing situ- 
ations. Experiments in using the media for educational purposes present 
two characteristics which make the extrapolations necessary for decision- 
making dangerous. 

These experiments are all different from each other. This is essen- 
tially due to the fact that the use of the media for education is too recent 
to be far removed from the trial-and-error stage. 

It is impossible, therefore, to draw from the case-studies conclusions 
which are generally applicable. 

The cost of technical facilities evolves very quickly and not always in 
a predictable way. Hence it is possible that even a close imitation of an 
existing system could imply a different cost. — — : 

The development of a new educational institution using modern 
technological media remains, and will remain, partly an ‘act of faith’ as 
has been said of the Open University. 


Conclusion 


In this survey, we have particularly emphasized the limitations, dif- 
ficulties and dangers of analyses which are too directly derived from 
neo-classical economic analysis and which therefore share its technical 
limitations as well as its ideological presuppositions. None the less, these 
efforts have their use, particularly the study of cost functions which will 
enable decision-makers to determine the financial implications of 


alternative policies. , . 
We must take heart from the tangible progress achieved over the 


past few years and continue to work towards elimination of technical 
inadequacies and limitation of the field of value judgements. 
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Cost analysis in educational technology: 
practical problems 


F. Orivel 


The first conference on the methodology of cost studies was organized by 
Unesco in January 1975 in Paris. A summary report of the conference was 
presented by Jean-Claude Eicher (1975).! 

A smaller panel of experts the 
some of the points raised by the 
meeting was made by the author (Orivel, 1975). 


within the international community, 
national Development (USAID) co 


technology: Cost Analysis for Educational Planning and Evaluation: Methodology 
and Application to Instructional Technology, 1976.3 


evision, one in the Ivory Coast, studied by cone 
emy for Educational Development,* and one 


d . 3 na 
Brazil, which was examined for Unesco by Arena, 
amison, Oliveira and Orivel.5 


he present working 
three papers on methodol 
of questions of imple 


" F F : he 
Paper will recapitulate the main points of iai 
ogy mentioned above, and will raise a num 
mentation arising from the case-studies. 


b Working Paper presented at the Conference on the Economic Analysis of Edu- 
cational Media, Washington, 


» D.C., 2-4 March 1977. 


of Educational Television in Maranhão, Brazil, Paris, Unesco; 
cf. new version in case. 


February 1977, -study below, Page 187. 
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Categories of costs and their measurement 


Classification of costs! 


Four types of classification of a complementary nature seem necessary if 
we are to obtain a complete picture and if the categories are to be suf- 
ficiently detailed to allow comparisons: 

First, a technical classification in which costs are categorized 
according to the various technical operations that have to be carried out 
for information (an educational ‘message’) to be received by the person 
or persons for whom it is intended. 

This classification raises problems of nomenclature, since certain 
costs are difficult to classify in one of the four categories, namely formu- 
lation of the message, production, transmission or distribution and recep- 
tion. For example, in which category should we place expenditure on the 
duplication of the recorded messages (films, tapes, etc.)? We could 
consider classifying them under production (for as many copies of the 
recorded message as will be required must be produced), under distri- 
bution or under reception. There is also the cost of rental or installation 
of cables for closed-circuit television, or the cost of maintaining liaison 
with the ‘pupils’. But these are, we believe, more often than not questions 
of common sense: all that is required is for the person carrying out the 
study to define and justify his choice. 

The relative cost of each stage in the process varies considerably 
according to the technical medium used. (Thus transmission costs are 
generally higher, in terms of production cost, for television than for radio.) 

Second the economic classification distinguishes costs according to 
whether they are variable or invariable, having regard to the dimension 
of the operation. 

It will be seen that certain invariable costs are fixed costs, i.e. they 
are incurred once and for all, or at least at considerable intervals (pro- 
jection apparatus, for example), whereas others are recurring, i.e. they 
are repeated from period to period (maintenance staff salaries). 

Certain authors include in their costs both the purchase price of 
equipment and an annual amortization in respect of such equipment. 
There is a danger here of including items twice, to the extent that the 
cost of repairs and maintenance, as well as the purchase of new equip- 


ment, are both reckoned. 
Some authors add an interest charge to amortization. From the wider 


economic standpoint, this is correct, since we are dealing with scarce 
resources that would have brought in a return if loaned (or invested 


1. cf. J. C. Eicher, ‘Cost-effectiveness Studies Applied to the Use of New Educational 
Media. Methodological and Critical Introduction’, The Economics of New Edu- 


cational Media, Vol. 1, op. cit., p. 17 et seq. 
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elsewhere). But since all we are doing is to compare the relative cost 
and effectiveness of different educational methods this addition is not 
necessary, and its omission obviates the need to make a choice—always 
arbitrary—of interest rate. 

The amortization calculation should be based, in theory, on the 
obsolescence and technical wear of equipment, but in practice it is some- 
times better to opt for a ‘financial’ amortization which takes into account 
the evolution of sources of finance and of currency resources where certain 
equipment has to be purchased abroad. 

Not only total costs, but also unit costs should be calculated. The two 
most useful categories of unit costs are cost per hour of contact and cost 
per student. They can be brought together to form a combined index: 
cost per student-hour. 

Some of these unit costs may prove invariable, where the corre- 
sponding total cost varies in proportion to the reference variable (number 
of hours, number of students or number of student-hours). 

Third, the accountancy or budgetary classification distinguishes 
between capital (investment) expenditure and operating expenditure. 

This distinction can be useful, inasmuch as it allows comparison of 
the cost of the initiatory stage, and the current operational costs of an 
established system. The figures needed for this classification, moreover; 
are often those most easily available, However, it is neither essential nor 
wholly satisfactory, since: (a) it contributes nothing further than the 
economic classification, in so far as the latter can be obtained in its 
entirety; (b) It 1s useless once the initial investment has been made, à$ 
only operating expenditures are subsequently involved; (c) itis not normal 
budgetary Practice, in the case of public funds, to include amortization 
charges in the operating expenditure budget. 

, Finally, the financial classification by contributor enables a distinc- 
tion to be made between direct and indirect costs, 
am Risener seen distinguishes between costs which are to be met by 
sponsible for capital investment, cost to be met by 
users, and costs falling to the community. 


e se ie wx bep articularly useful in instances where the pro- 
R e met by the two last payers is substanti importance 15 
heightened by the fact thatthe es y tantial. Its imp 


: of charge. Neverthel, h f setting UP 
transmitters and relay installati a ertheless, the costs o. IB 
i : lons were with a 
view to the full-time use of th peurred at the outset 
this investment should be char, 
to the hours used. Failure to 


self-delusion concerning the rea] 
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to believing that there will always be ready-installed transmitters 
providing a channel with available hours that can be ‘appropriated’ free 


of expense. 
Similarly, if part of the cost is met by the student (the purchase of a 


television receiver, for example, in the case of *tele-education"), failure to 
include it amounts to shifting, in an insidious fashion, the burden of the 
educational system from the public authorities to the individual. 

To sum up, the classification in Table 1 may be suggested as one which 
provides an exhaustive and ‘realistic’ picture of costs. 


'TABLE 1. Classification of costs 


"Technical costs Economic costs Financial cost (by contributor) 
Conception Fixed Educational authority 
Invariable Community 
Variable Family 
Others 
Production Fixed Educational authority 
Invariable Community 
Variable Family 
Others 
Transmission and distribution Fixed Educational authority 
Invariable Community 
Variable Family 
Others 
Reception Fixed Educational authority 
Invariable Community 
Variable Family 
Others 
TOTAL Torar 


TOTAL 
a a TU M S 


These costs can be calculated per student, per hour or per student- 
hour, according to need. Some of the spaces can obviously remain empty. 
We can now review what we already know concerning costs and their 


variations. 


Problems of application 


Several points seem to us to need reconsidering in this approach. us 
First, no distinction is made according to media. Such a distinction 
may be implied but we believe it is fundamental. Many studies ignore 


this aspect. 
In the examples of the 
broadcasts are accompanie 


Ivory Coast and Maranhão, schools television 
d by printed matter. It is possible to conceive 
of a television-based technology without written materials, or written 
materials without television. The costs of the two media must therefore 


be isolated from each other as far as possible. 
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Moreover, all the media utilized musi ies accounted for, including 
ten the most expensive medium. 
us Sete the costs of teachers in this way can Suri — = 
we apply the concept of production to the case of the teac = iude 
we shall have to include the cost of his or her training w " n des 
teacher as a medium. This is, in fact, what is done in the vory * ot 
where the educational television budget includes the training cos L. 
local teachers. The cost studies of this experiment include training y 
(in general). But in other contexts, as in Maranhão, the problem Dec 
ferent in that there exists on the labour market a glut of qualified Tw is 
tors. Educational television there is barely concerned at all with EE 
training and it is impossible to include training costs in the global analy: 
the experiment. 

» Second, the book raises the question of the inclusion of the costs i 
duplicating the recorded ‘messages’ (films, magnetic tapes, etc.). To thes 
may be added printing costs, . . ific 

Experience has shown that it is particularly useful, in this speci 
case, to be able to separate fixed costs from variable costs. far 

In other words, the heading ‘production costs’ should cover anes 
as possible all the fixed costs. In this connection we propose to abol on 
conception costs as a separate heading, as they are virtually impossr a 
to calculate, and to include them under production costs. Duplicatio! f 
or copying costs can either be grouped under a separate heading s 
their own, or included under the second heading, distribution cos 
—which take different forms according to the medium under consider- 
ation: transmission in the case of broadcasting, printing and distribution 


in the case of printed matter, copying and distribution in the case © 
films or photographs. 


Third, the economic cl 
variable is perhaps unn 
We propose to call 
number of students, and * 
number of students, Within each 


he i ife 
mortization charges according to the li 
expectancy of the equipment, 


Fourth, Eicher believes that in 
two technologi 
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of using existing structures, for instance when a commercial television 
studio is used to make schools television programmes. The direct costs here 


are the marginal costs incurred for educational use of the installation. 


The indirect costs are those which have to be added to the marginal costs 
in order to calculate average costs, i.e. an attribution in respect of fixed 
costs (amortization of equipment plus incompressible current costs). 


Description of physical resources 


Table of physical resources! 


The proposed table (Table 2) should be drawn up for the four technical 
ding to the implementation of asystem: (a) conception 


categories correspon 
utilization costs. 


costs, (b) production costs, (c) distribution costs, and (d) 


Taste 2. Proposed standard for costs 


Number of hours X number of students: ... X ++- 


1. Buildings of general nature Arca (m?) Hours of use Life expectancy 


per annum 
2. Special buildings 
Studios Arca (m?) Hours of use Life expectancy 
per annum (years) 
Other Area (m*) Hours of use Life expectancy 
per annum (years) 
3. Equipment and materials! Quantity Hours of use Life expectancy 
per type per annum (years) 
4. Consumable furniture and Quantity 
spare parts per type 
5. Labour per qualifications? In man-months 
per year 
6. Other resources 
Energy per type and 
mode of transmission Quantity 
Other Quantity 


1. Transport vehicles should be noted here. 
2. Qualification should at least indicate the level of education received at four levels: without 


qualification, primary, secondary or higher education. 
Application 


In Volume 1 of The Economics of New Educational Media, we stress the need 
for a description of the physical resources used. Experience has shown 


1. From: F. Orivel, ‘Standard Tables for Cost Measurement’, The Economics of New 
Educational Media . . -, Vol. t, op. cit. 
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convincingly how useful this recommendation is. For example, the exor- 
bitant cost of supplying electricity for television receivers in the Ivory 
Coast would be incomprehensible but for the knowledge that they use 
alkaline batteries. Sometimes it is appropriate to go further than the 
recommendation. For example, in the Ivory Coast again, foreign tech- 
nicians, still present in some numbers, cost much more than their Ivory 
Coast counterparts, and it is important to point out the cause of this 
difference in cost. 

However, in many Cases, a precise description of physical resources 
would be unnecessarily long. In Maranhào, the equipment inventory 
covers several hundred pages. The dull, tedious nature of such a list will 


characteristics and the kind o 


f resources brought into play. 
It has been suggested, 


moreover, that input in terms of human 
in full-time equivalents. This seems a wise 
it is somewhat more complex. Thus, in the 
state of Maranhão, in Brazil, the notion of full time is difficult to define. A 

s normal working week consists of five times five hours, either in 
on, or twenty-five hours in total. But he can 
wenty-five hours during his free half days, or 


do a part-time administrative job. Which definition of full time are we to 


adopt? 


Multiple inputs to the cost function 


Cost functions 


The extract whi i : > 
Mr deis » rin d follows is taken from the work by Jamison et al., 1976 


function of several variables; in our new example, TC = TC (N, h, x), the 
; > = > 
marginal costs become the amount total cost changes for a unit change in each 
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of the determining variables: in this three-variable example, we have three 
marginal costs defined mathematically by partial derivatives as follows:! 


Equation 1 


Each of these partial derivatives can be a function of N, h, and x. Likewise 
there is a number of average costs—the cost per student, TC/N, the cost per 
hour of presentation TC/h, etc. In addition, however, one may wish to consider 
composite averages: for example, the cost per student-hour. That cost would be 
TC|Nh. 

Aside from potential practical complications, then there is small concep- 
tual difficulty in going from consideration of a single determinant to multiple 
determinants of cost. In the analysis of the cost of ongoing projects, we will rely 
heavily on a cost function model that assumes total costs to be a linear function 
of the annual number of students in the system, N, and the annual number of 


programming hours, Å, as follows:? 


Equation 2 
TC (N, h) =F +VyN + Vh, 
where , 
F — the fixed costs of the system in the sense that they are independent of JV 
and h; 


Vy — the variable cost per student; : 

V, = the variable cost per hour of programming broadcast. — 

In order to let the number of students and programming hours in the system to 
be the sole determining cost variables, as in equation 2, it is necessary to let the 
values of F, Vy and V, depend on aspects of the system that are assumed to 
remain unchanged. F will depend, among other things, on the number of grade 
levels the students to be reached are in, as well as the geographical area over 


1. Similar to the discussion for any given value of JV, h, or x, the marginal cost 
with respect to JV, h, or x, can also be represented by the increase in total cost 
caused by adding one student, one hour of programming, or one square mile of 
coverage, respectively. This formulation would yield an accurate estimation of 
marginal cost only for a specified level of N, h and x, from which we want to 
examine an incremental expansion of one of the variables, holding the other two 
constant. The derivative formulation again has the advantage that it yields a 
functional representation of the marginal cost with respect to NV, h, or x that allows 
one to calculate the marginal costs of expansion of JV, h or x, at any level of the 
three variables without having to calculate the total costs in each instance. 

. It should be noted that a more detailed formulation of the total cost function 
would have several different types of h variables: production costs depend most 
closely on the number of programming hours froduced cach year; transmission costs 
depend on the number of programming hours broadcast annually; and reception costs 
will vary somewhat (due to the costs of supplying power to the television or radio 
receivers) with the number of programming hours the average television or radio 


set receives annually. 
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which they are spread, V, will depend on the quality of programming, while Vy 
will depend on class size. To the extent that the situation warrants assuming 
these other variables will change little the use of a simplified cost function such 
as that presented above in equation 2 is warranted . . . 


- - » Treatment of time: student utilization over time 
Our purpose is to develop a method for displaying the unit costs of an 
educational investment that takes explicit account of the time structure of util- 


ization as well as costs and that allows examination of costs from a number of 
time perspectives. The question of 


taking a project, a Minister of Education faces the substantial investment costs 


od for displaying costs from the perspective of 
tment to a project, one year into the project; 


(2) It may aid in understa 


1. It may none the less be wise to ab; 
] andon t] j i i i be 
incurred costs exceed the benefits of ami ieee TOM. = 
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(3) Itshould be noted that the potential for the use of the AC concept is much 
greater than would be indicated by the restricted definition given here, 
focusing on average cost per student. For example, for instructional tech- 
nology project evaluation it may be as, or more, useful to think of util- 
ization in student hour terms and the denominator could be redefined as 
such. More generally, the denominator could be defined in terms of any 
input or output of any production process, and need not only be applied 
to educational evaluation. 


Equation 3 


X GJG + 
AG; — o 
X MG 4-07 


kei 


A decision-maker at the beginning of i can in no way influence expenditures of 
student usage before time 7 so that costs and benefits incurred up to that time 
are for his decision irrelevant and are not incorporated into 4C;;. What AC,; 
tells him is the cost per student of continuing the project through year j; under 
the assumption that year j will be the final year of the project. By examining 
how 4C;; behaves as j varies the decision-maker can obtain a feel for how long 
the project must continue for unit costs to fall to the point of making the 
continuation worth while. When the decision-maker is considering whether the 
project should be undertaken at all, he should let i= 1; i.e. he should compute 
AC;; for various values of j. In these considerations ideally the decision-maker 
should base decisions on the value of AC;; calculated for the j corresponding to 
the end of the project, for his discounting of the future is already taken into 
account by equation 3. In the real world, however, there is a possibility that 
the project will be terminated prior to its planned end, and it is thus of value 
to the decision-maker to see how many years it takes AC;; to drop to a reason- 
able value and how many years more before it stabilizes to an asymptotic 
level. Clearly projections such as these rest on planned costs and utilization rates. 
At this point it may be of value to include a brief example to illustrate 
the concepts: in our example we assume a project life of 6 years. In year i a 
$1,000 investment is made and no students use the system. In years 2 through 
6 costs of $250 per year are incurred and 50 students per year use the system. 
Table 1.4 shows C; and N; for each of the 6 years of the project, and Table 1. 5 
shows 4C;; under the assumption that the social rate of discount is 7.5%, 
We should make a few comments about the values of AC;; in Table 1.5. 


"TABLE 1.4. Example cost and student usage 
eee 


Year i Ci (in $) Ni 
1 1,000 o 
2 250 50 
3 250 50 
4 250 50 
5 250 50 
6 250 50 


—_—ŘŘŘŘL OyO 
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Taste 1.5. Example values of AC;; 


— gua KA E 


Horizon year j 


6 

] 3 4 5 

Year i t abun 16.14 12.69 10.97 9:95 
E 5.00 5.00 5.00 Dno es 
s 5:00 pd es Pico 
3 5.00 5.00 » 

4 5.00 5.00 
5 5.00 
6 


| —-— ERE — 


First, there are no entries in the lower left; this is natural eciam 
horizon j must be at least as far into the futurc as the time from w. ormi 
viewed (1). Second, for values of 1 greater than or equal to 2, AC;; is un niet y 
$5.00 (= $250/50). This is because the only capital cost is incurred in p mer 
and from period 2 on, future costs and utilization are discounted to the pr E 
in the same proportion. (It is natural, once the capital cost is incurred, y is 
decision-maker view the unit cost as $5.00 from that time on). Third, dm 
infinite: because costs have been incurred and no students have used the ini 
the unit cost becomes indefinitely large. Fourth, in this example the interes ne 
numbers occur in row 1. As the time recedes further into the future, the w 


costs are spread over more students reducing AC;;: if the project had a long 
enough life, AC;; would become closer and clos 


shows how the average cost behaviour of t 


: t 
and the value of AC;; (for j near the project lifetime value) should be importan 
in determining wheth 


Cost per student based 
social rate of discount 
erence (h that is, utili 
measure by an even 
specific year, average 

It is the author’ 


most previous analyses 
function, we will also present suc i 
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specific notion of what this discount rate difference may be, the same rate will 
be applied to both resources and students in the analysis of instruction of 
technology costs. It is interesting to observe that in an entirely separate effort, 
Levin! also suggests the use of a cost concept which takes into account system 
utilization over time, and which additionally would discount this utilization 
stream by an appropriate discount rate; in essence, his suggestion amounts 
to a general description of the type of AC;; concept we have developed and 
presented above. 


Application of cost functions 


Cost-function estimates, based as they are on the distinction between 

fixed and variable costs, meet with three types of difficulty: 

I. Those fixed costs which are normally considered (administration, 
production, transmission) are not strictly speaking fixed. If a project 
increases significantly in size, it would be a mistake to think that its 
administration costs will not rise also. But we have few means of 
determining in what proportion these costs will rise. 

2. Certain fixed costs may increase sequentially, and each sequence can 
differ from the preceding one. This is the case, in particular, with a 
television system's network of transmitters. The first zone to be 
covered is generally the easiest, the one which reaches the largest 
number of students. The network is then extended in phases and 
each new zone will differ, both in terms of the cost of the extension 
and in terms of the number of potential students. 

3. Finally, certain variable costs may show a non-linear variation, 
i.e. they may not be strictly proportional to the number of students. 
In particular: (a) base costs, i.e. teachers and classrooms, tend towards 
a slight increase in many cases, because of a fall in the average number 
of students per class or increases in salaries in real terms; (b) unit 
maintenance costs generally show a decline. Thus, in the Ivory Coast, 
extending the system has led to a more rational deployment of 
maintenance services, thereby reducing costs per class; (c) in the 
Ivory Coast again, the substitution of solar batteries for alkaline 
batteries will lead to progressive reductions in the cost of supplying 
electricity for television receivers. 

In the examples of the Ivory Coast and Brazil, the absence of real variable 

costs made it impossible to calculate Jamison, Klees and Wells’ cost func- 

tion, with its third term designed to account for variable costs in the pro- 
duction of television programmes. Thus, in the Ivory Coast, the volume of 
television production could be increased considerably (and probably more 
than doubled) at virtually zero marginal cost. In Maranhão, where there 
is far less production capacity (two studios instead of five), up to 700 pro- 
gramme hours per year were being produced at a time when video-tape 


1. H. M. Levin, ‘Cost Effectiveness Analysis in Evaluation Research', in: 
M. Guttenberg (ed.), Handbook of Evaluation Research, Sage Publications, 1974. 
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i r of 
stocks were insufficient. At present, the figure is about one quarte 


that, around 175 hours per year, which gives an idea of the great elasticity 
of their production. 


The problem of output standardization 


With 700 programme hours per year from two studios in Maryan ami 
on average about 100 hours per year from five studios in the Ivory oe 
the question arises of the level of programme quality. In Maranhao, = E 
two-thirds of the television programmes consist of a recording ol en 
instructor in medium close shot, delivering his lecture, which is "p Qon 
illustrated by photographs or hand-drawn or printed pictures. dw Te 
other hand, the Ivory Coast’s programmes tend more to resemble In 
‘dramas’ of commercial television, which clearly cost much more. 
other cases, for example, in the United States, the recorded p à 
consists solely of the instructor's ‘talking head’, thus reducing costs sity 
very low level. At the other extreme, for example, the Open - ape 
in the United Kingdom, programme production comes very close to sity 
standards of film production for the cinema. This considerable diver "i 
of types of output gives rise to a very wide divergence in cost per ar e 
follows: $100 for the instructor's ‘talking head’; $500-$2,000 in Maranhao, 
$5,000 in the Ivory Coast; $20,000 at the Open University. aus 
How can these four products be compared? Are they homogeneo™> 
or are we to consider them as four different products? . tion 
Finally, we would stress that there is practically no informa 


) cus : s : iency 9 
available to indicate the comparative degrees of instructional efficiency 
these four products. 


Problems of marginal costs 


Here we consider the case where 


. g mon to 
one of the input resources is com 
several utilizations. A typical cas 


r se 
e is that of a broadcasting opi or 

both for educational Purposes and for the general public. There are 

kinds of situation: 


E ich is under- 
Case 1: School television. finds an existing network which is UD" <; 


ED n e F 
utilized and Which, in particular, is free during school ot de 
cally, school television Carries the marginal utilization aa es for 
including both the cost of additional electricity and low charg 


A le, in 
extra maintenance and supervision. This is the case, for examP'*» 
the Ivory Coast. 


. : ithin the 
Case 2: At the other end of the scale, school television is set up p me the 
area of coverage of the existing network, or even in a zone W 
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network has insufficient transmission time available during school 
hours. If, as is the case in Maranhão, the school television system has 
to take upon itself the establishment and all the operating costs of the 
transmission network, these costs are no longer marginal. 

Case 3: Finally, between these two situations, schemes for joint use of 
networks involve calculation of the average cost per hour which is 
then charged to the users according to the number of hours of use. 

This type of charging problem occurs not only in connection with the 
transmission network but also for many other elements such as: (a) use of 
television production facilities for extracurricular purposes; (b) use of 
television receivers in schools for other purposes—thus, in the Ivory Coast, 
we allocated to non-educational purposes 20 per cent of the (very high) 
cost of supplying electricity to television receivers in schools (should we 
have proceeded in the same way with the purchase costs of receivers, 
aerials and masts, and their maintenance?); (c) use of duplication equip- 
ment for non-educational printed matter. 


Economic analysis and education: 
critical issues in application to 
instructional technology evaluation' 


Steven J. Klees and Stuart J. Wells 


Outcome measures 


Much attention has been centred upon cognitive achievement, as 
measured on standardized tests, as the sole criterion of educational 
effectiveness. While this is an important process outcome, it 1s by no 
means the only one of interest. Other effectiveness measures considered 
important include changes in: the distribution of test scores to determine 
potential reductions in educational outcome inequality; drop-out rates; 
repetition rates; analytic capabilities; creativity; inquisitiveness; and a 
wide range of social and economic behaviour. To a developing country 
expanding its educational system, differences among systems in terms of 
the rapidity with which the school population can be reached are also 
of importance. 


1. Working paper presented to the Conference on Economic Analysis of Educational 
Media, Washington, D.C., 3-4 March 1977. 
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For non-formal education programmes such as those in community 
development or agriculture, imparting knowledge is of obvious import- 
ance. However, there should be an even greater interest in fostering an 
ability to convert knowledge gained into action. The changes in agri- 
cultural production derived from the action would be considered a 
benefit. Interest might also be displayed in creating a self-help or inno- 
vative capacity within certain population groups. A more direct, yet 
less satisfactory, effectiveness measure for non-formal education may be 
the size of the audience attracted to the programmes. 

To make decisions about educational alternatives, it is essential to 
evaluate educational outcomes such as those above. Economic analysis 
contributes to this evaluation by providing frameworks and methods 
designed to approach the question of assigning value to these different 


evaluation. 


From effects to benefits 


centuries (dating prim 
in 1776) by economis 
economy, or the operati, 
market principles. 
According to this ver: 


: sion of s are others, 
which will be briefly discus 2, economic theory (there 


valu : rin- 
tion’s resources as efficiently as possible. One of the P are 
ate of affairs is that businesses 


y a firm are priced on 
hey produce arc priced on t 
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If market prices truly represent social value (see Jamison, Klees, and 
Wells’, 1976, discussion of shadow prices), profits in this theoretical 
system represent a signal to the producer that the output they produce 
is more valuable to society than the societal resources that are utilized 
in the production process. 

Regardless of the extent to which this perfectly competitive world 
reflects fact or fantasy, one concern that has grown out of this system of 
thinking resolves around the means by which the public sector can 
make wise investment decisions. The private sector theoretically has 
profits to guide it as indicated above. However, public-sector investments 
often involve the production of goods or services which are not directly 
marketed. How should a nation’s government decide which alternatives 
before it are most socially valuable? The methodological procedure 
devised by economics to answer this question is cost-benefit analysis. 

Cost-benefit analysis involves the valuation of the outcomes of public 
sector investment in monetary terms and the comparison of these benefits 
with the cost of the investment. Just as profits are a guide for the private 
sector, cost-benefit analysis provides a criterion of social worth for invest- 
ment decisions, again given that prices truly reflect social value. The 
trick, of course, is to translate public-sector investment outcomes, which 
are not directly marketed, into some monetary value equivalent. 

In educational system evaluation, most economists have taken the 
approach that although outcomes of interest are not measured in mon- 
etary terms, they can be translated, at least in part, into monetary 
outcomes since the main ‘products’ of educational services, the students, 
enter the labour market. The hypothesis made is that formal and non- 
formal educational experiences result in the embodiment of additional 
skills and traits in the individual, yielding ‘human capital’ that makes the 
educated individual more economically productive, and thus increases 
the general productive capacity of the economy, thereby contributing to 
economic growth. If this additional productivity due to schooling can 
be measured, then one can compare a measure of the societal benefit in 
monetary terms with that of societal costs in monetary terms for a 
particular educational endeavour. Unfortunately, economic productivity 
1s not easily measurable and the alternative most economists choose to 
measure is income. The connection between the two is again based on 
competitive market theory; in a perfectly competitive economic system 
the wage an individual receives is equal to the productivity that he adds 
to the firm. If this connection holds (and it is far from clear that it does), 
then the additional income due to schooling is also a measure of the 
additional productivity due to schooling. 

4 Empirically, economists have approached this cost-benefit evalu- 
ation of educational systems in four ways: through rate of return, pro- 
duction function, labour force planning, and social demand studies. 
Rate-of-return analysis yields measures of the individual and social return 
9n Investment in education by examining the relation of schooling to 
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earnings. Production function analysis attempts to establish a more direct 
connection between education and productivity. Labour force planning 
efforts use assumed relations between education and sectorial growth to 
yield guidelines for educational expansion. Social demand evaluation 
relies on the implicit value educational consumers place on educational 
services. All four approaches differ to some extent, and each has its 
relative limitations and strengths (c.g. see Blaug, 1970). 

However, perhaps more critically, all of the above approaches rely 
on the assumptions of competitive market economic theory to yield the 
connections between educational outcomes and social value—chicfly 
that wages and prices reflect the value of social productivity. To the 
extent that there are significant problems with this particular economic 
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money exercise influence over what goods and services are produced by 
society in direct proportion to their greater wealth. To a large extent, 
competitive market theory ignores any such equity considerations. 

These latter points raise questions that are difficult for cost-benefit 
analysis, as formulated at present, to deal with. The economist’s concept 
of ‘society’ as some abstract entity that receives all the benefits and 
incurs all the costs of any particular investment activity is called into 
doubt—first, because ‘society’ as an aggregate of individuals has different 
preferences at different points in time that are affected by its earlier 
resource allocation decisions; second, because ‘society’ consists of indi- 
viduals and groups with unequal power and thus total benefits exceeding 
total costs will not necessarily prevent some individuals or groups from 
being hurt by a decision;! and third, in a more realistic view, because, 
given this unequal power, decisions may be made whereby the global 
benefits are inferior to the total costs as long as the costs are imposed on 
a group other than the group receiving the benefits. 

The two problems discussed above, taken together, form a critique 
that questions the basis of most Western economic thought and conse- 
quently that of the cost-benefit analytic framework that is most commonly 
used. First, it is not clear that monetary values represent societal values 
and, second, it is not clear what ‘society’ as an aggregate concept 
really means. 

Alternative economic viewpoints have been advanced, perhaps the 
most coherent centring around the works of Karl Marx and subsequent 
additions to the theories he initially expounded. Bowles and Gintis’ (1975) 
Schooling in Capitalist America and Martin Carnoy’s (1974) Education as 
Cultural Imperialism provide an application of such thought to the analysis 
of educational systems. A primary conclusion of this literature is that 
educational system changes cannot, by themselves, resolve any of the 
most pressing societal problems—e.g. inequities of wealth and power, 
widespread alienation, severe poverty in developing nations, etc.—but 
that what is needed is a basic restructuring of the national and inter- 
national economic system (see Carnoy and Levin, 1976, for a good 
discussion of this point). 

No definitive prescription for cost-benefit analysis comes out of 
Marxist thought (cost-benefit analysis in its broadest meaning 1s still 
sensible as it simply refers to a basic rationality in decision-making), nor 
do the criticisms of the competitive market model yield a clear solution 
to remedy its deficiencies as now applied. However, at least two general 
points do seem to emerge. First, one should be as much concerned 


1. In theory, it is assumed that if the total benefits exceed the total costs of any 
activity, then that activity should be undertaken since those individuals who might 
be disadvantaged by the activity could be compensated and thus all persons 
would benefit, or at least not be hurt. In practice, such compensation 15 usually 
unlikely to occur. 


The economics of new educational media: cost and effectiveness 


40 


about cost and benefits to different individuals and groups of individuals 
as about costs and benefits to the ‘society’ as a whole. Second, less 
concern should be directed to translating educational outcomes into 
monetary units. Alternative conceptions of development and economic 
progress can perhaps yield outcome measures that consider a wide range 
of social effects, incorporating impacts on equity, balance of payments, 
local or national autonomy, leadership, and other areas of socictal 
interest. However, multiple outcomes in different metrics brings us back 


to the question posed earlier of aggregating different effects within a 
cost-effectiveness framework. 


Alternative aggregations of outcomes 


Apart from an extensively developed framework that covers questions of 
social efficiency, economists also bring a set of technical approaches to 
combining multiple educational outcomes or outcomes that occur over à 
period longer than one year. As most commonly utilized, cost-effectiveness 
analysis does not go beyond the stage of determining the impact O 

alternative strategies on the criteria of interest. It is left to the decision- 
maker to evaluate implicitly the overall worth of each alternative, pre- 
suming that no one alternative automatically dominates, and then make 
her/his decision. However, from the point of view of encouraging the 
decision-maker to think through the effectiveness trade-off more carefully 
and to allow these trade-offs to be scrutinized by other decision-makers 
and public interest groups, it can be useful to employ techniques which 
bring out these trade-offs explicitly. 

Economists would examine outcomes (and costs) over time from the 
perspective that positively valued outcomes occurring in the present B 
valued more by the individual and the society than if the same outcomes 
were to accrue at some time in the future (and that dollars spent today 
are worth more than the same amount in the future). To the extent shat 
this is true, if different educational strategies have a different incidenc® 
of effects (and/or costs) over time, they may be valued quite differently» 
even if they have similar effects ( 
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serious limitations of this technique for treating multiple effectiveness 
criteria are: the reliance on the subjective value judgements of the 
decision-makers and the potential effect of ignored criteria on the 
decision. Economists tend to prefer transformations to monctary amounts 
because of the alleged objectivity of the price system. However, there is 
nothing inherently wrong with subjective judgements, and there may be 
no escape from them anyway, as we discussed previously. The difficulty 
is that the decision-maker must somehow judge the relative worth of 
change in different criteria. Pessemier (1966) describes a technique 
similar to that above, but which attempts to transform outcomes to a 
monetary metric in which the decision-maker asks such questions as: 
*How much more money would I be willing to spend to achieve the 
following change in the criterion of X?' Perhaps more development 
along these lines would be helpful. 

The second limitation in some senses is even more serious. As the 
analytic difficulty increases with the number of criteria chosen for 
analysis, the decision-maker utilizing the technique described will elim- 
inate many criteria from consideration. It is important that this elim- 
ination be of the criteria which are considered less valued, rather than 
those criteria which are difficult to analyse. Furthermore, it is important 
to be rather comprehensive in the initial conception of what effectiveness 
criteria are relevant to this decision, especially taking into consideration 
effects that may be unintended but socially valuable and none the less 
detrimental. 


Relating inputs to outputs 


In the discussion of how an economist looks at educational outcome 
measures, we have ignored the critical question of translating system 
inputs into system outputs. In the first section, we discussed a theoretical 
framework (see Klees and Wells, 1977, for a detailed analysis of efficiency 
concepts) that economists bring to educational evaluation in the form of 
Cost-effectiveness and cost-benefit analysis—efficiency in the sense of 
allocating resources to those activities whose value is somehow judged to 
exceed their cost (either through aggregation by prices or by decision- 
maker judgements). We also discussed some of the more significant 
Problems in making such efficiency judgements, even if information 
about the costs and outcomes of alternative educational strategies were 
available. In this section, we look at the question of whether, even 
assuming the efficiency framework of most economists to be a reasonable 
one, the empirical investigation techniques currently available to social 
Science are capable of shedding light on causal input-output relationships. 

The economists’ approaches to both cost-effectiveness and cost- 
benefit analysis require an answer to such questions as: How do edu- 
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cational resources affect educational outcomes of interest, e.g. cognitive 
achievement of various types? How much of income differences between 
individuals are actually caused by differences in education? How much 
of the productivity differences between workers or farmers with different 
educational levels are actually caused by those educational differences? 
What specifically does education do to bring about existing income or 
productivity differences? How does consumer demand for education 
react to changes in the price of that education? The classic scientific 
response to questions of impact (that is, to questions of causality), the 
experiment, is often politically or practically difficult to accomplish with 
much rigour and the assignment of cause to some broad ‘black box’ 
treatment labelled ‘education’ or ‘new educational strategy’ is usually 
somewhat ambiguous. This is due, in part, to a growing concern for 
practical (as opposed to statistical—see discussion below) significance 
which brings even the proper form of the experiment into question 

(e.g. whether to use identical budgets, identical materials, or design the 
best pedagogical strategy for each educational alternative). 

The lack of possibilities for structuring what science considers rig- 
orous experimental tests to examine the impact of education, or O 
alternative forms of education, has led many social scientists to embrace 
recently developed statistical methods to analyse non-experimental infor- 
mation collected ‘in the field’. The growing literature on education 
production functions, educational demand functions earnings functions, 
and agricultural and manufacturing production functions, attest to the 
dominance of regression analysis as the principal method for suc 
empirical investigations. 

: For regression analysis (or its related methods—for example, analysis 
of variance, partial correlation analysis, or path analysis) to generate 
oe answers to these questions, at least three principal conditions 
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but not much. The theory as to exactly how and why consumer demand 
for any good is influenced is also not very refined. In all cases, our 
ability to rigorously quantify the conceptual variables we do consider 
theoretically important is inadequate. 

To the extent that the conditions necessary for regression analysis 
techniques to give an accurate portrayal of causal relationships are not 
met, the question that follows is how inaccurate will the results be? 
There does not seem to be a clear-cut answer to this, even in theory. 
There seems to be a tacit agreement among most social scientists to 
place less faith in the magnitude of the regression coefficients than in 
their sign. That is, all that is usually claimed is that one variable has a 
positive or negative influence (as opposed to no influence) on a dependent 
variable of interest, as opposed to claiming that a one-unit change in one 
variable will cause x units of change in the dependent variable of interest. 
Unfortunately, it is this latter claim that is necessary for estimating the 
benefits of educational investments. Furthermore, some of the problems 
with regression analysis may lead one to doubt if even the sign of a 
variable’s coefficient is correct, which may explain why the results of 
educational production function analyses in the past have frequently 
been inconsistent. 

None the less, the above considerations notwithstanding, we cannot 
make a decision without either assuming or determining something 
about ‘causal relationships’. Rational decision-making rests on comparing 
the projected costs and consequences of possible alternative strategies of 
action. The relevant question then becomes, do quantitative empirical 
investigations of relationships add something to our individual or col- 
lective common-sense judgements?! Most social scientists would clearly 
answer this question affirmatively; the expectation is that replication of 
studies on different samples has to some extent yielded and will in the 
future yield some generalizable, consistent results that can serve to 


1. There does exist a growing body of literature that is asking these types of question. 
For example, Crain and York (1976) question the efficacy of field study methods 
over experimental methods, even for large-scale social programmes. However, 
even the utility of the experiment is questionable. Starr (1974), in an article that 
looks at ‘the edge of social science’, discusses the ‘ideology of the hedgehogs in 
social science’, who never deviate from a straight and narrow, but distorted 
(according to Starr), view of empirical science. A view that allows quantitative 
‘data’, ‘like the shadows in Plato’s cave . . . [to] become more real than the world 
itself’. 

‘The repudiation of other forms of discourse, the neglect of validity in pursuit 
of reliability; the reification of data as things-in-themselves, the illusion of false 
precision, these are not by any means necessary aspects of empirical science. But 
they are frequent enough to warrant mention’. (p. 410) A 

Cohen and Garet (1975) and Phillips (1974) discuss similar problems and 
also call for new forms of discourse (ones that recognize other forms of observation 
and evidence than that provided by significant coefficients) among researchers, 
as well as between researchers and policy-makers. Cohen and Garet suggest 
funding competing political views to undertake the same evaluation. 
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inform decisions. The principal caution, given the methodological prob- 
lems above, is that common sense, experience, and judgement be used to 
interpret such quantitative findings. Still, the above considerations merit 
more debate on these points. 


Concluding remarks 


There are a few important points related to the previous discussion that 
should be mentioned and a few tentative conclusions that should be 
drawn out of the total analysis. Again, these points are relevant to edu- 
cational | evaluation in general; for a more focused discussion of the 
applications of these concepts to instructional technology evaluations 
see Klees and Wells (1977, especially Sections II and IV-D). 

First, an obvious difficulty with both cost-effectiveness and cost- 
benefit analysis as usually practised is the bias towards those criteria that 
are most easily quantifiable. This bias leads to a failure to consider out- 
comes, such as social integration or social equity, that may be valued but 
for which outcomes the decision-maker finds it difficult to discriminate 
among the effects of various alternatives. It should be recognized that 
these economic frameworks do not necessarily, in their broad sense, require 
quantification—they only require that the decision-maker conceive © 
his/her decision in terms of a comparative weighing of the costs and effects 
or benefits of alternative policy strategies. It should be noted also that the 
nt of techniques to quantify nebulous concepts and incorporate 
M " decision analysis framework (e.g. see Pessemier, 1966) may 
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as a filtering mechanism that allows those who already have greater 
productive ability and motivation to pass through and be more readily 
identified by employers. Berg also argues that the school is primarily a 
certification mechanism, but goes on to suggest that even the labelling 
process may not have any economic worth because employers engage in 
conspicuous consumption of school graduates (that is, employers are willing 
to pay higher wages to graduates than to non-graduates even though the 
former may not be any more productive than latter). If Arrow, Spence, 
Berg, or Gintis are essentially correct, the stress on cognitive outcomes 
as a measure of educational project success has perhaps been vastly 
overemphasized. 

Third, throughout this paper we have emphasized the analysis and 
effectively ignored the analysts. Carnoy and Levin (1975), in an article 
which is directly focused on research efforts related to the economic 
analysis of instructional technology alternatives (but which has wider 
application) spend a considerable amount of energy looking at the poten- 
tial effects of who is doing the analysis. In particular, they apply the first 
‘law’ formulated by James Q. Wilson (1973) in his article about policy 
evaluation: 


First law: All policy interventions in social problems produce the intended 
effect—if the research is carried out by those implementing the policy or their 
friends. (Carnoy and Levin, 1975, p. 387) 


Carnoy and Levin argue that much of the research undertaken to evaluate 
instructional technology alternatives is sponsored by agencies that have a 
vested interest in the technology projects themselves. They hypothesize 
that these agencies choose researchers who often have an implicit bias in 
favour of the technology and tend to structure the evaluation so as to give 
the ‘benefit of the doubt’ to the technology alternative. To the extent that 
this is true and that such biases markedly affect the results of an analysis, 
this is clearly a very serious concern. 

Carnoy and Levin, in the same article, also acknowledge that 
Wilson’s (1973) second ‘law’ may apply to them since this ‘law’ states: 


Second law: No policy intervention in social problems produces the intended 
effect—if the research is carried out by independent third parties, especially 
those skeptical of the policy. (p. 387) 


Both of Wilson’s ‘laws’ together raise the same two essential questions that 
have come out of the total analysis above. First, as regards conventional 
economic analysis, is competitive market theory a reasonable framework 
on which to base educational analysis, or is it simply a reflection of 
ideological prejudices? Second, how much can the empirical methods 
available to social science discriminate among competing cause-effect 
hypotheses about how the world actually works? Our intention is not to 
berate social science nor to despair of progress. Our intention is to 
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stimulate discussion of what we consider to be the most basic issues of 
economic analysis applied to educational evaluation. 

Two tentative strategies may be suggested in the light of our con- 
sideration of the two questions above (in addition to our recommendations 
earlier to look at costs and benefits for different population groups and to 
be concerned with developing a wider array of effectiveness measures than 
those currently being studied). First, research activities should perhaps be 
carried on and utilized at a much more micro level than is now the case. 
That is, part of the reason for insignificant or inconsistent research results 
may be caused by attempts to generalize relationships that are simply 
not generalizable. For example, the factors that most affect learning 
within one particular school environment may not be relevant to another. 
If this is true, it would imply that both decision-making power and 
research and decision analysis capabilities should be much more decen- 
tralized than they are now. 

Second, we should be aware that most social science today (the 
common approaches to cost-effectiveness and cost-benefit analysis are no 
exception) emphasizes the effects of the characteristics of aggregate indi- 
vidual actors and often ignores totally the influence exercised by the pro- 
perties of a particular structural system. As an example, a great deal of 
effort has been expended via educational production functions to examine 
the characteristics of students and teachers that affect cognitive learning. 
However, the major policy variable which will affect student cognitive 
learning is probably the choice of a curriculum. The ‘no significant differ- 
ence’ finding in the literature comparing alternative instructional techno- 
logies indirectly supports this view. Walker and Schaffarzick (1974), in 
reviewing the empirics of the curriculum theory literature, stress the 
common-sense conclusions that if subject-matter is included in the cur- 
riculum (instead of being excluded from it) students will learn it better, 
and the more it is emphasized the better it is learned. While this may seem 
trivial at first, it is likely that the greatest policy leverage that we have 
over what is learned is via what is included and emphasized in both the 
overt and the hidden curriculum. Consequently, the investigation of those 
structural properties of an educational and socio-economic system that 
determine the nation’s curriculum should deserve at the very least equal 
weight with research directed toward the effects of differences between 
individual characteristics within that structural system. This same point 
can be applied to almost any facet of social science research in genera’ 
and to educational research in particular. 

Finally, we should recognize that there exist competing descriptions 
of the social reality we live in, and that our discussion indicates that the 
analysis of system costs, effects and benefits depends in part on the 
description of the work we choose. The distinction between decisions 
made for ‘political’ reasons and those made for reasons of *economie 
rationality’ may be less a distinction on the basis of rational decision- 
making (for both may or may not be rational), than a distinction along 


Results and problems 
47 


the lines of what specific goals are being sought after, how one evaluates 
benefits divided among competing interest groups and, in general, who 
has what degree of control of the relevant decision-making power. Econ- 
omic analysis is most useful to the extent that it makes decision-makers 
more aware and more explicit about alternatives and their various conse- 
quences. Once again, however, such analysis should not be taken as defini- 
tive, but as informative, to be interpreted with caution and common 
sense, based on the knowledge of both its strengths and weaknesses. 
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Understanding ‘success’ in communication 


technology: a review of some 
Third World projects 


Emile G. McAnany 


The setting of the problem 


There are a number of ways to define success and therein lies the critic E 
problem with evaluation. Whose criteria shall we use when measuring 
success in such major social interventions as education health e 
nutrition? Judgement is no longer only the domain of oliticians but ° 
researchers who have attempted through the develo Ls ofa scientific 
discipline called evaluation to render these jud caval of success 
failure more ‘rational’ and ‘objective’, not to $ E uere The neart 
vir a is that all social interventions oe based on values ae 
Pad and peli x of criteria for success or failure reflect cert® 
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educational technology! in Third World countries. Although I accepted 
this invitation, I have preferred to attempt a more modest undertaking.? 
The theme I have chosen to address concerns the factors which contribute 
to success and failure in technology projects in Third World countries. 
It is the contention of this paper that the successful application and 
significant deployment of communication technology in formal and non- 
formal education? depends more on the contextual or structural factors 
of the particular setting than on the planning and design factors. 

The latter have been given increasing attention in the policy 
literature because professional planners either do not seem to realize how 
these contextual factors influence the outcomes of even the best designed 
projects, or, when they do recognize them, feel incapable of changing 
them (Mayo and Spain, 1977; Handcock, 1978). Likewise, evaluators 
often concentrate on the internal efficiency of a project and judge its 
success by criteria related to this rather than by the longer-term external 
goals that are most influenced by structural factors. 

Success in the evaluation literature can be defined in two ways: 
(a) the achievement of defined project goals or, (b) the positive conse- 
quences of the intervention, whether defined or not. The latter have 
often been given the unfortunate name of ‘unintended’ effects which 
introduces the whole problem of intentionality into the definition of 
objectives. (The problem of bias this raises has caused one well-known 
evaluator, Michael Scriven (1973), to redefine the evaluation under- 
taking as ‘goal-free’ in order to avoid trying to figure out what planners 
intended and looking at what the intervention has produced.) Regardless 
of whether we agree or disagree with Scriven’s approach, we need to pay 
serious attention to outcomes and not to tie them too closely to stated 
objectives which may or may not remain constant over time or reflect the 
entire gamut of effort that a project has undertaken. 

A careful distinction between what economists have called external 
efficiency and internal efficiency is called for in analysing a project's 
outcome. This is roughly equivalent to what some evaluators (Suchman, 
1967) have called the long- and short-term objectives of a project. To 
illustrate, an educational technology project using radio may be highly 
successful in training rural school children to learn mathematics but the 
graduates of rural primary schools may have no greater opportunity for 


1. Although there are purists in education and communication who disagree, I use 
the Wo terms ‘communication technology’ and ‘education technology’ inter- 
changeably. I include not only hardware and software in these terms but the 


i i d of applying the technology as well. 

2. mimi dU npe sie odds aded sources cited in the references of 
this paper, but some specific ones are Schramm (1977); Spain, Jarmon and 
McAnany (1977); Jamison and McAnany (1978); AED Corn ecam (1975); 
Mayo, Hornik and McAnany (1976); Mayo, McAnany an ~~ (1975). 

3- This would include regular school subjects and literacy as well as programmes 


in health, family planning, nutrition and agriculture. 
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employment than before. The system is internally efficient in teaching 
mathematics and indirectly helps the flow-through rate, but externally 
it is not successful. A grade school diploma does not benefit the rural 
student who has earned it. 

In the subsequent examination of some recent technology projects, 
I wish to review the planning and implementation stages to discover 
what factors both internal and especially external, seem most to constrain 
the achievement of benefits. On the basis of this examination, I wish to 
indicate some policy implications for the future planning and evaluation 
of communication and educational technology. 


Complicating factors for success and failure 


Objectives 


Before considering some recent technology projects, we need to begin 
with discussing objectives. As I have mentioned before, objectives are a 
slippery reality. One of the common problems evaluators face is that © 
trying to define clear objectives for projects they wish to evaluate. 

The problems with objectives are multiple. First, objectives are not 
as a rule clearly defined and the imposition of clarity by the evaluator 
distorts the reality of what is happening in the intervention, if not W at 
is going on in the head of a project director. Secondly, objectives change 
= time and should do so as the project adjusts itself to the reality 9 
: olira] « kien the promoter of the project sells his or her idea 0 
E es or long-range criterion and the implementors and evaluators 
rete concentrate on a short-term educational goal. For example, t 
> rim programme Sesame Street was sold to the United States. Congress 
but ia fines learning gaps between minorities and the middle class, 
pause i ng was procured, the shorter-term educational goals © 

ryone’s’ learning (with, naturally, the middle class learning OF 
were Py eerie (Cook et al., 1975). 
deu about objectives is related to the third but is mior 
Mn. x T E ave implicit as well as explicit consequences M 
eei pci en] in the ‘intention’ of the project planners: : 
xci E ur Au E as good, they are called objectives, if they po 
tu dedil M gt 

. : a ? 
therefore, these outcomes ate een, called deaf vg qe ‘hat 
only good effects are the ‘intended’ ones. Now. as rat T 4 benefit 
depends on who defines it as a benefit. i ids 


And herein lies the complexity of ; enef! 
measurement: What is good fo Y of outcome evaluation, of D her, 


r one z " ot 
rr eae babe os Em ata ee 
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to provide primary equivalency education to rural drop-outs. The project 
‘succeeds’ in training 15 per cent of this group at a low cost and with 
reasonable efficiency. As a consequence, the graduates all migrate to the 
urban areas to continue school or look for jobs. The individuals may gain 
but the rural area may lose an asset. No one 'intended' the migration 
away from the rural areas; in fact, there may have been an explicit 
objective that primary schooling would help make students more pro- 
ductive farmers. Thus the net loss of the best people to the rural areas is 
a ‘side-effect’ or ‘unintended’ outcome. But defined or not, it was inherent 
in the context of the project and it may have even been intended by a 
central planner who saw the need of more qualified labour for the 
modern sector. Then we have a conflict of objectives and of outcomes and 
are squarely faced with the dilemma of evaluation, in determining 
whether a project is a success or a failure. Should we judge the project by 
how it benefited the urban or the rural sector? Benefit alone should not 
be a criterion of success; the question needs to be asked, who benefits? 
Success for the urban sector may be at the expense of the rural sector. 


Equity, or who benefits? 


Questions of equity have made the work of evaluation more difficult over 
the last decade. Development theory during this period has begun to 
emphasize distribution as well as growth (Chenery et al., 1974) and 
communication research has begun to examine not only how much infor- 
mation diffuses among rural people but also whom this benefits (Rogers, 
1976, McAnany, 1978). Many bilateral and multilateral aid institutions 
have adopted a conscious policy of directing their grants and loans at the 
poor majorities in the least-developed countries and equity has become 
a major objective of programmes and therefore a criterion of success. 
Evaluation, if it is properly done, involves several problems in the 
face of this drive toward equity. First, it should be applied to a project 
at an early stage when objectives are being discussed, and one of its tasks 
may well be to examine the assumptions that are implicit in project plans. 
For example, many rural radio projects try to programme information 
for farmers of small-scale farming in order to help increase the pro- 
ductivity of their yields. There is an assumption that increased infor- 
mation can help improve yield for these farmers. But it may be that 
although the intention is good, the increase in information alone has no 
significant impact on yield and income unless coupled with increased 
investments (Contreras, 1979; O'Sullivan, 1978). If an evaluator knew 
this before the project began, he or she might suggest that only farmers 
of large-scale farming would benefit from such a programme, Should the 


evaluator suggest abandoning a programme that would benefit some: 
what ‘larger’ landowners (say from 2 to 5 hectares) and not the ind i 
farmers? It depends on how one defines the criterion of success and who 


benefits. Ora project has already been implemented, how does an evalu- 
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ator decide which farmers to call ‘small’, and how to set the criterion 2 
success? And should the evaluator, for example, point out that in ‘a 
area 30 or 40 per cent ae een consists of landless labourers w. 
at all from the project? 

Ru med difficult aud challeagité task for the evaluator, however, 
is not in defining assumptions of projects or even in measuring a "es 
of outcomes but in explaining why the results turned out as they did. 
This is what Suchman (1967) called ‘process evaluation’ or the exam- 
ination of those factors that help explain why a project succeeds or oe 
As he points out, we are most often interested in why a project does A 
work in order to improve the current effort or improve planning for 
future projects. ' 

I would like to spend some time examining a few recent projects to 


point out what factors (whether planned or not) significantly influenced 
the outcomes of those projects. 


‘Successful’ projects 


According to the thesis proposed above, the factors that account most for 
the successful application and widespread use of technology in Mss 
World countries are contextual and not planning ones. Let us examin 

briefly some examples of what are generally considered ‘successful’ uses O 


communication to test the viability of the assertion and to identify a” 
discuss some of these factors, 


Development communication 


In the area of development communication, the Tanzanian radio ie 
campaigns (1969-75) are widely agreed to have been ‘successful’. d 
basic criterion of success in this case is sheer size. Beginning with only 
few hundred people, by 1973 the campaign on health involved about "i 
to 2 million adults. The evaluation of this campaign (Hall and Porri 
1977) suggested that not only did audiences participate in weekly ; 
cussion meetings but also learned about health practices and participat 
in actions, including the digging of 750,000 latrines. A second example < * 
a successful experiment in communication for development is the Basi 
Village Education project now concluding its work in Guatemala. Ra 
messages, sometimes complemented by a monitor for discussions c 
sometimes by an agronomist as well, seem to have influenced (5m? 


f t re 
farmers An an eastern province of the country to adopt significantly d 
innovative agricultural practices and hence to increase productivity 

compared to a control group of 


farmers (AED, 1977). 
Improving quality in formal school 
The use of educational media to im 
the formal school setting can be 
Salvador instructional television 


. i in 
prove the quality of instruction ta ] 
illustrated by two examples, te 
(ITV) system (Mayo, Horni 
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McAnany, 1976) and the Radio Mathematics Project of Nicaragua 
(Suppes, Searle and Friend, 1978). In the first, a national educational 
reform adopted television as the centrepiece for change in curriculum, 
Supervision, administration, etc., for grades 7-9. Subsequent evaluation 
indicated an improvement in general ability skills attributable to tele- 
vision and a ‘catalytic’ effect of television in promoting system changes. 
The Radio Mathematics Project is a pilot test of mathematics teaching 
by radio in a rural province of Nicaragua using daily thirty-minute radio 
programmes with active student responses. Results show large and 
significant gains of experimental over control students. 


Extension of schooling or distance learning 

In regard to the extension of schooling to populations without oppor- 
tunities for enrolling in regular schools, three projects may illustrate 
what is often referred to as open or distance learning. The Mexican 
Telesecundaria was less ‘open’ and more structured than those projects 
that have modelled themselves after the British Open University, but it 
is an example of the extension of schooling. It provided classes for 
students in grades 7-9, especially in the rural areas, where no regular 
secondary schooling was available. This was accomplished through tele- 
vision carrying the major instructional tasks with accompanying texts 
and a primary teacher as a class monitor. Results of an evaluation 
(Mayo, McAnany and Klees, 1975) showed Telesecundaria students 
doing equally as well as regular secondary students in a system that cost 
less than the traditional one. The Santa María Radio School in the 
Dominican Republic is a national primary equivalency system based on 
a distance learning model (individual radio reception, written assign- 
ments, weekly tutorial meetings with a teacher, etc.) that has enrolled 
about 20,000 students and graduated about 11,000 or 12,000 a year 
(1972-75). According to the results of an evaluation (White, 1976), 
Radio Santa María provides rural youth with an education equivalent, 
or superior to, traditional means and at a cheaper cost. A final example, 
Which I draw from a series of distance learning studies being sponsored 
by IBRD, but not yet published (Perraton, 1978), is the Republic of 
Korean's Air Correspondence High School. In this project, senior high- 
School students study by radio, printed texts and correspondence. This 
provides about 22,000 students with an opportunity of finishing a high- 
School degree while working. The preliminary results (Lee, Futagami, 
Braithwaite, 1978) are encouraging in terms of efficiency and cost 


considerations. : y 

Ihave cited some generally known examples of ‘successful communi- 
cation technology projects for the purpose of identifying the factors in 
these projects, at both planning and implementation stages, which seem 
most likely to have accounted for this success; and, secondly, determining 
which values were operating in the evaluator’s criteria of success. 
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Factors contributing to success 
Contextual factors 


Let us begin with what seems so obvious that it is treated almost perfunc- 
torily in the literature on development projects. This is the political 
commitment of a government to change and development. The commit- 
ment means certain priorities will be held and that choices will be made 
accordingly. Thus, for example, the Tanzanian Government chose to 
emphasize rural development over urban industrialization and the radio 
study campaigns which were geared to rural areas had full government 
backing and collaboration. But there is an added aspect of political 
commitment which is difficult to measure and which often does not enter 
into assessments of projects, namely, a kind of charismatic support that 
leadership can lend to the work of project personnel. 

The Tanzanian radio study campaigns have been much quoted in 
development communication literature as being a model for other 
countries in dealing with their rural development needs. But the major 
difference between the United Republic of Tanzania and many other 
countries is that the former had an effective political commitment to 
rural development implying priority allocation of resources to such à 
purpose. When rural communication projects fail in other countries; at 
least one factor to examine is the extent to which the government is really 
committed to rural development. The primary factor which influences 
change in rural areas is a political commitment to that change, without 
yon education and communication, however well planned, can only 
: s d into impact. Cuba over the past fifteen ycars has almost 

y eradicated many of the direct indicators of underdevelopmen™ 
hk malnutrition, illiteracy, poor health and large gaps between city 

al ountryside. What this indicates is a governmental commitment 10 
zh s of better health and educational services for everyone an 
allocation of resources to that purpose. 


B . 
sub id not need to look at the total political commitment we 
Republic of T ange as evidenced in countries like Cuba and the Unite 

P or Lanzania. On a more limited level, this same commitme? 


is o i i 
Hacer d in a leader who has enough political influence oe 
Fanaa get a project started and institutionalized before he OT? s 

le project. Such a factor is often left unmentioned in evaluation 
because it cannot be neatly quanti: 


E fied i iti alities © 
projects, we recognize that it is a am il mu projec 

succeed. We may mention the crucial role that Walter Beneke as Min 
ister of Education played in the Salvadorian ITV project. President 
Nyerere of the United Republic of Tanzania —Ó tnl a little £7 
the enthusiastic response that almost two million persons gave to ‘ 

radio campaigns of 1973 and 1975. The early a of the Mexica” 
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Telesecundaria were much influenced by its founder and leader who 
managed through political influence to overcome opponents and get the 
project’s secondary degrees recognized. Finally, one wonders to what 
degree the success of Radio Santa Marfa is attributable to the vigorous 
leadership exerted by its director who not only brought efficiency and 
drive to the project, but a political shrewdness that allowed the private 
organization to get its primary degrees accepted officially. 

Another set of factors that seems critical in explaining the success of 
some of these projects is the motivation of the target audience. The 
motivation and political mobilization of Tanzanian peasants have already 
been referred to. El Salvador built educational reform and an ITV system 
on the basis of people’s expectations of, and demands for, more education. 
The distance learning examples in Mexico, the Dominican Republic and 
the Republic of Korea all tapped strong motivation to get further edu- 
cation. In the first two projects this education probably meant migrating 
to the city and finding a job; in the latter project it meant a rise in salary 
for young Korean workers. The projects, for the most part, did not have 
to create their own enthusiasm. They offered people something that 
seemed useful and they could build upon the base of widespread interest. 


Planning factors 


The factors mentioned thus far have been external or contextual ones, 
but we cannot overlook the influence of internal factors as well, such as 
the efficiency and planning capabilities of project personnel. The Korean 
and Dominican, as well as the Nicaraguan and Guatemalan, projects 
manifest a coherence and efficiency in planning and organization that 
undoubtedly contributed a great deal to their effectiveness. The organ- 
izational structure of each, however, shared an important common 
element: none was part of the large government bureaucracy that usually 
diminishes the efficiency of even well-planned projects. Radio Santa 
Marfa was a church-related organization run by a remarkably efficient 
director working with a small central staff. The Republic of Korea’s Air 
Correspondence High School was attached to a special R&D group in 
the Ministry of Education. The Nicaraguan Radio Mathematics Project 
and the Guatemalan Basic Village Education projects are experiments 
controlled by some highly qualified expatriates but not operating as yet 
as fully governmental agencies. The problem that confronts pilot projects 
such as the latter two is precisely the transition from an experimental to 


a fully operational stage. | ; 
A second element of planning that has contributed to the effective- 


ness of these projects is the attention paid to the content and the design 
of the messages. The Basic Village Education and Nicaraguan Math- 
ematics Projects have devoted a significant proportion of their budgets 
to this aspect. The Guatemalan project first studied the agricultural cycle 
and adapted carefully researched radio messages to the changing needs 


The economics of new educational media: cost and effectiveness 


56 


of farmers, from soil preparation through harvest. Radio Mathematics 
performed R&D research on each year of the curriculum through 
continuous feedback from students. The Air Correspondence High School 
in the Republic of Korea and El Salvador’s ITV also put emphasis on 
careful content preparation but in a much less intensive form than the 
two experimental projects in Central America. 

A final item that should be noted about the internal factors that 
were an clement in the success of some of these programmes is the 
learning model that underlies them. Radio Santa Maria and the Radio 
Mathematics Projects have an active learning approach in which students 
respond to the radio message while it is being broadcast. There can be 
no doubt that this has contributed significantly to learning (Suppe? 
Searle and Friend, 1978; White, 1976). The United Republic of Tanzania’s 
method in the discussions following radio broadcasts sought to promote 
the contribution of each member of the group to problem clarification 
and to downgrade the dominant role that the discussion leader often 
assumes. Evaluation showed an increase in farmers as discussion leaders 
over teachers in that role from 1971 to 1973, and a larger number 9 
people contributing to the discussion in the group (Hall and Dodds, 1977): 

We have discussed both contextual and planning factors that 
contribute to the success of seven technology projects. It is difficult, if not 
impossible, to sort out the exact amount of variance in the outcome 
variables attributable to these and to other factors. What is more 
important is to recognize that significant factors which may not be casily 
ee ae do intervene significantly in the level of success or failure 

e measured with our traditional evaluation instruments. 


Criteria in judging ‘success’ 


i ira bi pisse is that, however scientific or objective our evalu- 
ae pee Ocology may be, we constantly rely upon a value base, either 
ae Th somcone else’s, in choosing the criteria by which to judge $ 
1 zt i seven projects already discussed may be used as a basis for 
exp m this last point a little more deeply. 
ns n a review of educational technology evaluations published several 
y e x two critics were asked to comment on the findings of thes? 
udies (Carnoy and Levin, 1975). Their critici valu- 
; A à (975). Their criticisms were that the €V^ 
mae LUN biased in two ways: (a) all of the evaluations wer" 
conducted by those in favour of educational technology or working for 


. w 
quantifiable, often help to illuminate eeh 


: = m 
particular way. Two examples fro: a 971 


1. Administrative histories, although not 
or why a project has performed in a 


nology projects are M 
on the hon Coast. ayo and Mayo (1971) on El Salvador, and Grant 
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agencies thus inclined and gave a positive interpretation (or ‘benefit 
of the doubt’) to results; and (b) the evaluations narrowed the scope of 
study to items on the agenda of the sponsor. The critics admitted that, 
for their part, they were negatively biased toward educational technology 
and that, had they made the evaluations they would have found quite 
different results. Such an ‘adversary’ approach to evaluation may make 
some people uncomfortable, but it provides a healthy way of controlling 
bias in research and helps to enlarge the perspective from which tech- 
nology is evaluated. Some of the concerns of these and other critics of 
technology will be explored briefly below. 

One key point to clarify in discussing the outcome of technology 
projects is the extent to which we concentrate our evaluation on internal 
efficiency and effectiveness or on external efficiency and longer-term 
benefits. I have illustrated this point above and have explored it in more 
depth elsewhere (Lenglet and McAnany, 1977). I would argue that most 
of the judgements of success of the projects under discussion are based on 
shorter-term benefits of internal efficiency and not on longer term, 
external efficiency benefits. There are several reasons for this and several 
consequences which we shall explore in the subsequent pages. 

It is clear that because of the fact that Basic Village Education and 
Radio Mathematics Projects are experiments, they are judged by a dif- 
ferent set of criteria from other interventions. The problem they face is 
whether they can or will be expanded to operational systems. Although 
the criteria for the evaluation were rigorous and the evidence carefully 
gathered, the control exerted over the environment by implementers may 
prove, as with all experiments, the greatest obstacle to their translation 
into functioning systems. What the experiments seem to demonstrate is 
that under special circumstances radio can be used successfully to impart 
agricultural knowledge or teach mathematics but not that it will do so 
when more usual circumstances prevail and the context is able to exert 
a more typical influence on outcomes. 

The El Salvador television project has been carefully evaluated 
(Mayo, Hornik and McAnany, 1976), but there are a number of other 
criteria that the evaluation did not take into consideration, which would 
mean qualifying the term ‘success’. One argument raised by critics is 
that even though ITV in El Salvador achieved shorter-term learning 
goals, longer-term goals of the Educational Reform, such as providing 
more qualified labour for an expanding industrial sector, were not 
achieved. Another argument is that success must be judged in the long 
term when the initial enthusiasm has worn off and problems have had 
an opportunity to emerge. Finally, the longer term study of ITV in 
El Salvador might show its bureaucratization and increasing inefficiency 
and lack of flexibility (Werthein, 1977). Jn : 

It might be thought desirable to study the Dominican Radio Santa 
María, not as White did, in comparison with traditional adult education, 
but for its effects on increasing the rural exodus. White's study suggests 
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that a large portion of Santa María students plan to leave the rural areas 
for the city at the end of the eighth grade. The same approach to the 
Telesecundaria in Mexico could be adopted in evaluating the outcomes 
of that school system. The efficiency of these two systems in producing 
graduates needs to be balanced against the social costs for the rural areas 
from which the best human resources are being drained. 

The Air Correspondence High School in the Republic of Korea has 
not yet studied the effect of background characteristics on entrance to, 
or continuation with its courses. Such a study may well reveal that the 
project, although it provides further learning opportunities for some, 
does not do so for all who wish or demand it. It may only make a small 
contribution to a limited group and widen gaps with a much larger grouP 
who cannot take advantage of the opportunity. 

Finally, the Tanzanian radio campaigns have been judged suc- 
cessful on the basis of the two most recent campaigns in 1973 and 
1975- The influence of historical circumstances in promoting nation 
enthusiasm may have contributed significantly to the wide participation. 
One would need to study several more campaigns to see whether the 
approach has been institutionalized enough to carry on in changing 
national circumstances before declaring the campaigns successful an 
certainly before asserting their usefulness for other countries with very 
different circumstances. 

, _ Critics lodge several arguments against technology and demand that 
it be judged by broader standards. They say that it is more costly than 
e been claimed; that it is a centralizing and controlling force in edu- 
eng people according he dominant ideology e dc oue qe 
it does not solve the viec Der dicii aique of ird Wor 
countries; that the de fi probis that plague moss e t o 
ecl Sie ee grees from distance learning systems are node 
date cad a g taining jobs even if they may provide adequate cognitiv 
PARE ihe nally, EUR it creates the impression that something 15 being 
vec Veg de pauio ne ee A roose 
EA AE DEEE A e aa a i A EM 

Yet dese hice pne ro into consideration. | hich 

Technolóey 3s 3 : „call for is a widening of criteria by wt 
gy is judged; for instance, the inclusi f criteria involving 
longer-term outcomes that have often be dub. ionis d. In other 
oaste We heed m famnnor ed een left unmeasured. ep 
ks pte carefully the impact of structural factor 
erm outcomes (Contreras, 1979). In still other cases We nee 


to admit that neither technology nor education is likely to change basic 


structural factors. Nevertheless, these factors need to be taken int? 


aue f x 
sche bags "e the planning stages of projects so that more modest goal 
and more realistic criteria for outcomes utilized. 
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Conclusions 


What major conclusions may be drawn from the previous discussion? 
First, that we recognize all criteria to be based on an implicit or explicit 
set of values. As a consequence of choosing a set of criteria, the focus of 
attention in assessing outcomes will be restricted and exclude consider- 
ations of other possible costs and benefits. Second, that in the past we 
have judged too much by internal efficiency standards and not given 
sufficient attention to the longer range implications of educating people 
with technology. Third, that we have not yet paid sufficient attention to 
intervening contextual factors that both greatly affect short- and long- 
term outcomes and overshadow the effects of national planning and 
organizational efforts. However, the mitigation of these structural factors 
allows these planning and organizational efforts to make substantial 
contributions. Fourth, that equity as a criterion of success imposes a 
somewhat different set of criteria for benefits than those used in the past. 
Equity will also probably impose greater costs, since it is often more 
difficult to reach, educate and employ those whom society's structures 
have placed toward the bottom of the scale. Finally, returning to my 
basic thesis of the preponderance of contextual factors over planning 
factors, I do not wish to give the impression of a necessary contradiction 
between the two. Rather, I see the most successful application of 
communication or educational technology when both contextual and 
planning factors are favourable. Hence, I would suggest that a planning 
strategy be adopted to search for these contexts that promise the best 
results from an application of a rationally planned use of technology. We 
would thus avoid the irrational hope often manifested by planners, that 
technology alone can overcome the major social problems faced by a 
society. Rather we would be able to use the available technology to 
assist societies which have confronted these problems and are looking for 
a tool to help them. 
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The role of values in economic analysis 
of education’ 


Kiran Karnik 


‘Development’, said H. G. Wells, ‘is a race between education and 
Catastrophe.’ Like much of his science fiction, the reality of this statement 
is also now dawning on us. There is increasing realization all over the 
world of the importance of education to development. What was once 
considered desirable and beneficial to the proper development of the 
individual’s personality has now been recognized as a prerequisite of 
economic growth and national development. Education is thus considered 
as one of the inputs necessary for economic development; an economic 
commodity; or a process capable of ‘adding value’. 

With this education-development relationship in mind, most 
countries are spending increasing amounts—and even increasing pro- 
portions—of growing budgets on education. If almost all this money were 
to go into ‘conventional’ education—i.e. into the regular traditional 
school system—then the main worry would be how much of the national 
budget should go into education. A decision on this would involve some 
economic analyses, but would be fairly straightforward if appropriate 
boundary conditions were clearly stated. However, the limitations of 
the traditional system are becoming increasingly obvious, especially in 
a situation involving rapid expansion of education and educational 
opportunities, 

For example, consider the present situation in India; literacy has 
increased from about 17 to go per cent in the last two decades, while the 
number of primary school children has gone up tremendously—from 
under 20 million in 1950-51 to over 60 million now. Undeniably, this 
18 good progress. But is it enough? Let us for a moment look at the 
Problem of literacy, not in percentages but in human terms. In 1950-51, 
just under 300 million Indians were illiterate. The figure now is about 
400 million. Thus, in the last quarter century, we have added 100 million 
illiterates or over 10,000 illiterates every day. Free and compulsory 
elementary education up to the age of 14 is a Directive Principle of our 

onstitution. This, however, remains a dream even thirty years after 
independence. , 

The ‘qualitative aspect of the problem—though more difficult to 
define—is certainly far worse. In 1965-66, 50 per cent of the lower primary 
School teachers and 40 per cent of the higher primary teachers had not 
ven matriculated. The position has not altered radically since. The effect 
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of these underqualified, untrained teachers on the educational system is 
not only bad education, but an unfair imbalance of opportunity—the 
privileged few (in urban areas, of course, where all privileges reside) 
getting the benefit of the handful of well-qualified and good teachers. — 

Almost all developing countries which have placed greater emphasis 
on traditional educational methods are in the same plight. Clearly, one 
has to think of new approaches and new strategies to tackle this immense 
problem. Fortunately, technology has provided the basic tools which can 
lead to a definite strategy. However, the best strategy will clearly vary 
from country to country and situation to situation. There is therefore a 
range of choices, a number of alternative approaches, strategics, media 
mix and so on. Evaluating these and then selecting the optimum one is 
the task of economic analysis. Cost-effectiveness and cost-benefit analyses 
are the two primary methods in use. 

Both techniques involve the identification of all cost elements and 
some definable measure for the output or goal. Temporal differences (in 
terms of expenditure at particular periods of time) are provided with a 
common base by discounting—using the discounted cash flow method. 
Of crucial importance here is the assumed rate of discount. It is supposed 
to reflect the social cost of capital or the opportunity rate. Different rates 
can lead to different conclusions in terms of ranking alternatives. Oper- 
ational details of these two methods are fairly well established and a large 
body of literature exists on them. Further details are therefore not 
discussed here. 

For any proper analysis, it is clear that a definition of goals is the 
crucial starting-point. Goals can either be determined outside the system 
or can result from interaction within the system and an analysis of the 
alternatives. While allocation of funds to education is supposedly the 
result of a detailed input-output exercise for the economy as a whole and 
a projection of long-term needs, in reality one can safely assume the 
budget to be a given, fairly inflexible figure. It is therefore, necessary to 
conceive of a methodology to allocate this budget rationally to the various 
claimants. A reasonable division of end-use would be by type and level 
of education, i.e. non-formal, adult, pre-primary, secondary, high school, 
graduate level, post-graduate, doctoral, etc. 

Allocation of funds between these different competing claims 
could—and should—be based partly on an analysis of the nation’s man- 
power requirements. As an example, funds may have to be invested in 
setting up new engineering colleges if manpower requirements for the 
future indicate increased demand not capable of being met by existing 
engineering institutions. In such cases, given the definite objective of 
producing JV-trained engineers within T years, one can most fruitfully 
use cost-effectiveness analysis to determine the optimal method or strategy 

for achieving this goal. y 

However, a considerable amount of the education budget is inevi- 
tably—and quite rightly—spent on the basis of very long-term anticipated 
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needs and on the basis of a philosophy or principle. An example of the 
latter is the stated desire in India to provide free and compulsory edu- 
cation for all up to the age of 14. At the same time, there are other 
competing demands, some rather pressing, e.g. adult literacy, others 
politically necessary (a university in cach region of each state, etc.). What 
analytical tools can help objectively to determine relative priorities in 
such cases? Among the more commonly used techniques, there is little 
doubt that cost-benefit analysis is the best. It must, however, be noted 
that in spite of what economists might say about the methodology being 
objective (as engineers say about technology), there is little doubt that 
the results of a cost-benefit analysis depend to a large extent on the 
ideology or at least viewpoint of the analyst. This situation arises because, 
while most costs are amenable to objective quantification, benefits gen- 
erally are not. What, for example, is the relative benefit of educating a 
city child as opposed to a rural child? Given a fixed sum of money, should 
it be invested in adult literacy or in pre-primary education? What is the 
social benefit of accelerating a given education programme so that it is 
completed in T—n instead of T months? dem 

The quantification of such benefits is a highly subjective process and 
the results depend greatly on the analyst's viewpoint or philosophy. To 
take a concrete example, the investments made in the Satellite Instruc- 
tional Television Experiment (SITE) for morning broadcasts to children 
could very definitely have covered a larger number of schoolchildren if 
the investments had been made in a city—Bombay, for example. Thus, 
a cost-benefit analyst using standard benefit indices such as cost per 
student per year, or a composite index such as cost per student per year 
for one hour of instructional programme, would prefer to cover school- 
children in a large city. : 

The implicit assumptions of the analyst are that: (a) there is no 
differential benefit in reaching one group of students as against another; 
(b) the gain (however defined) is similar, on the average, in any group of 
students for a given exposure; (c) the quality of programmes is either 
irrelevant or an invariable factor; (d) the secondary impact on teachers 
or others is negligible. à 

The Fes is dne listed above are indicative and not exhaustive. The 
basic problem with this approach is that it does not even try to get at the 
real benefits; instead it uses the number of students as the primary benefit 
variable. Obviously, this approach has the advantage of simplicity and is 
of apparently universal applicability. But this is precisely the main 
danger: such simplistic, easy-to-use approaches tend to proliferate very 
fast and to be used for decision-making. It need hardly be pointed out 
that this methodology would result in heavily favouring precisely those 


pockets of affluence and privilege (and here we are particularly concerned 


with the point of view of developing countries, where such methodologies 


are adopted and used very quickly indeed) in urban areas which already 
have all the advantages. Thus, a seemingly innocuous methodology, used 
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blindly, would strengthen the status quo and make equity an even more 
distant dream. Even though those who evolved this methodology may not 
have intended it, we begin to see how techniques and methods tend to be 
value-loaded. 

A ‘neutral’ analyst (if such an animal exists) inevitably adds to the 
value-orientation of the technique by applying it blindly. Any economic 
analysis must accordingly be based on a clearly enunciated philosophy 
or value system. Taking further some of the earlier issues and questions, 
and on the basis of a particular value system, one would like to take the 


following into consideration as part of the function that defines the 
benefit: 


Gain in knowledge among students. . 

Increase in curiosity/questioning among students improvement in 
teachers’ teaching ability. 

Inequality ratio between the best schools and the schools chosen for 
analysis. 

Ratio of average income of these students’ families as compared to the 
national average. 

Decrease in truancy. 

Decrease in drop-out rate. 

Improvement in the status and image of the teacher in the community. 

Number of students who are actually exposed to the programme. 


Number of hours of school programmes broadcast per day to the par- 
ticular area concerned. 


Relevance of programmes. 

Percentage availability of set (i.e. in working order, switched on and 
power available) during broadcasting times. 

Changes in the value system. 

The listing is neither in order of i 


intended to be indicative of the type of factors that may be considered as 
giving a particular philosophy or value orientation. Clearly, some of the 
factors would be irrelevant in some countries; this listing is mainly from 
the Indian perspective and in the context of television broadcasting to 
rural schoolchildren. 
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variables indicated above would be difficult even to determine, but that 
is hardly a reason to ignore them or minimize their importance. An actual 
working of a cost-benefit analysis on the basis of the above is feasible, even 
if some benefits have to be left as statements and not quantified. An 
analysis of this type would indicate the relative advantages of concen- 
trating on backward rural areas as opposed to urban areas. To the above 
must be added the time dimension; for example, the number of years 
saved in achieving a given objective by this approach as compared to the 
next best. 

The factors listed clearly show a leaning towards rural areas and 
towards the deprived classes. This indicates the subjectivity of the cost- 
benefit approach in social areas and the consequent importance of having 
a commonly agreed philosophy or ‘credo’, on the basis of which the 
analyst establishes his point of view. A i 

If the credo emphasizes reaching rural areas, taking education to 
those who need it most, establishing greater equality of educational 
opportunity and functional literacy, the cost-benefit ratios of alternative 
strategies can then be worked out for such goals. If time is also important 
(who would deny it, especially in a developing country?), then clearly the 
strategy must include components that provide quick, extensive coverage. 

Such coverage can be achieved quickly only through broadcasting 
and—particularly in isolated and poorly developed areas—through sat- 
ellite broadcasting. SITE already demonstrated this capability with great 
success. For example, the educational programme for children was viewed 
by about 150,000 children every morning and, while a specific evaluation 
of the impact of these programmes is still under way, it can confidently 
be asserted that these programmes have had at least limited success. 
However, no cost-benefit study has yet been carried out though a detailed 
cost analysis does exist. š NS 

While a detailed analysis must be made to prove this point, it can 
also be confidently claimed that a multimedia package assures the best 
cost-benefit ratios. An example is the highly successful teacher-training 
programme conducted during SITE (in November 7 975) when about 
24,000 primary school teachers were trained in science teaching. A 
similar exercise was carried out just before the end of SITE, in July 1976, 
and a similar number of teachers was reached. Detailed cost figures, 
impact assessments and other details for this are not immediately avail- 
able, but a cost-benefit analysis based on the methodology and philosophy 
outlined earlier would be an interesting exercise. For the philosophy 
assumed here, preliminary investigations indicate that the optimum 
strategy would include satellite television as a major component. This 
could conceivably lead to the creation of a ‘national educational grid’, 
However, any such national grids—or large-scale broadcasting for that 
matter—often have certain inherent disadvantages or negative by-products. 
It is the job of the methodology or of the cost-benefit analyst to ensure that 
such negative effects are also given due consideration in the analysis. 
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One possible danger is homogenization. Media—and television in 
particular—tend to standardize people’s emotions, feelings and culture. 
This is bad enough generally, but particularly dangerous when it 
occurs in the process of education—for every school and university may 
then ‘become the sausage machine which turns out people without any 
real culture and incapable of thinking for themselves but trained to fit 
into the economic system ...’.1 If education is to be the process by which 
a person is taught to think—how to think and not what to think—then 
such standardization is clearly unwelcome. Standardization and the 
media’s role in shaping thought—in determining what to think—lead to 
a discouragement of diversity and to the perpetuation of one type of 
system. The ‘freedom’ of the individual is then constrained to remain 
within the boundaries of this system, as has been so convincingly argued 
by Marcuse and others. 

In any educational strategy, educationists must guard against such 
tendencies. A sophisticated cost-benefit analyst would, in fact, begin to 
indicate the non-optimality of such systems—provided the input in terms 
of the philosophy (which, as was shown earlier, determine benefits) is 
appropriate. A cost-benefit analysis should, therefore, in this case indicate 
as benefits (and high benefits) such things as diversity (of thought and 
expression), decentralization, and increase in curiosity or inquisitiveness 
(e.g. among children, the propensity to ask more questions). After all, 
the process of education consists in teaching people to question the society 
they live in. 

It is recognized that many factors are difficult not only to quantify, 
but even to identify. However, it is of crucial importance that, in try- 
ing to perfect a smooth and efficient model, the basic factors are not 
overlooked. In this regard, I would again like to emphasize the crucial 
role of national policy or philosophy in cost-benefit analysis. Any purely 
‘objective’ analysis not informed with these considerations would be a 
sterile exercise. 

Much of the effort and frustration involved in carrying out a cost- 
benefit analysis is related to the problem of quantifying benefits. The 
economist would ideally like to convert all costs and benefits to money 
terms, or to some single index. However, ‘rational individuals’ and 2 
‘perfect market’ exist only in textbooks. The process of decision-making 
(at least in most developing countries) is likewise not always determined 
by economic factors. Economists would do well to keep this in mind and 
not worry too much about trying to quantify everything. In fact, leaving 
some benefits merely as statements is often far more effective. 

Another danger is the tendency of analysts to worry about the tem- 
poral element in costs only. All costs are carefully annualized and dis- 
counted using social rates of return worked out with great difficulty and 


I. Gabriel Cohn-Bendit and Daniel Cohn-Bendit, Obsolete Communism: The Left-wing 
Alternative, New York, McGraw-Hill, 1968. 
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sophistication. However, the importance of time in relation to the benefits 
is often ignored. Is it not more beneficial that the individual be literate 
today rather than three years hence? With our immense problems which 
time only compounds (over 10,000 illiterates added every day in India, 
for example), we should do well to remember an old saying: ‘Space we 
can recover, time never... I may lose a battle, but I shall never lose a 
minute.’ 


Measuring the effectiveness of instructional radio: 
the methodological issues 


Howard P. Tuckman and Tewfik F. Nas 


The main purpose of effectiveness analysis is to determine the extent to 
which a programme is successful in meeting its objectives as defined either 
by the organization concerned, its funding agency, its clientele, or the 
larger society to which it belongs. Effectiveness analysis provides a 
measure of what is accomplished by a project. It also offers an insight 
into how effectively the stated goals of the project are met. As we shall 
see, what is accomplished often differs from what the organization wishes 
to accomplish. This poses a problem in determining the criteria by which 
effectiveness is measured. : 

From an economist’s perspective, the appropriate measure of the 
effectiveness of a project is the one that most closely captures the outputs 
which that project actually produces. The limits on what is termed an 
acceptable output are set by the scope ofthe analysis. Ifthe organization 
undertaking the evaluation is concerned with internal efficiency, the 
benefits should be limited to those which affect the organization itself. 


1. This corresponds to the treatment of the level of analysis common in cost-benefit 
studies. Sce, for example, R. N. McKean, Efficiency in Government | Through Systems 
Analysis with Emphasis on Water Resources Development, New York, John Wiley, 1958. 

2. A project evaluation based on the internal standards of the project's designers 
or of its current administrators provides a measure of efficiency, albeit an internal 
one. What is important is not whether social welfare is maximized in the aggregate 
but rather whether the project is mecting its internally defined goals. A difficulty 
with viewing a project from this perspective 1s that an effective project may none 
the less be one with no tangible impact on its participants. For example, a project 
with the stated goal of transmitting ten hours a day would be judged equally 
effective by this criterion whether 50 people or 50,000 listened. Likewise, a project 
designed to raise reading scores ten points would be judged equally successful 
whether people retained these skills or lost them. 
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If the study is to be used for comparative purposes, especially in compari- 
sons across countries, the perspective should be a more global onc. 

No matter what the perspective of the analysis, the primary purpose 
of engaging in effectiveness analysis should be to compare effectiveness 
with cost. Especially in developing countries where capital is scarce, it 
makes little sense to select the best project irrespective of cost. The efficient 
choice is the project with the highest effectiveness per dollar of project 
cost. Where project choice is made solely on the basis of effectiveness, the 
project designer implicitly decides to forgo efficiency as a criterion. This 
may be justified where the goal is to purchase the best project irrespective 
of cost. But relatively few developing countries can afford to make choices 
on this basis, at least at present.? 


How quantitative a measure? 


The above discussion implicitly assumes that the outcomes of an effective- 
ness study are sufficiently quantitative to permit comparison with similar 
projects elsewhere. In practice, studies of effectiveness run the gamut 
from the purely descriptive to the fairly mathematical. 

Purely descriptive studies are not usually useful in facilitating project 
comparisons. While such studies are inherently interesting, and while 
they serve to record the operations of a project at a moment in time, they 
rarely provide sufficient information to allow the decision-maker to 
decide whether project A will offer more benefits than B, or whether A is 
better for providing education in mathematics or animal husbandry. 
Descriptive studies provide information on an organization and its 
general cffects on people. They serve best in an informative rather than 
a comparative context. 

A multitude of quantitative output measures are available to measure 
effectiveness and we shall discuss some of these below. In many effective- 
ness studies, the presence of a number of output indices poses a problem. 
Where all the benefits can be denominated in dollars, social welfare is 
optimized by picking the project with the largest dollar yield per dollar 


1. It is imperative that the scope of the benefit measures of a project coincide with 
the scope of the cost analysis. If an inclusive measure of costs is to be derived; 
the measures of effectiveness should be equally inclusive. If this procedure is not 
followed, an implicit bias is introduced into the data. 

2. Such are the mechanics of the economic system that even those countries with 
windfall incomes from oil, such as Venezuela and Iran, have found that purchasing 
the best item irrespective of other constraints can lead to rapid inflation and to 
commodity shortages. ; 

3. Compare, for example, the discussion of D. T. Jamison to that of Hudson 1n; 
Radio for Education and Development: Case Studies, edited by P. L. Spain, D. T. Jamison, 
and E. G. McAnany, Washington, D.C., IBRD, 1977. 
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of cost. The presence of a dollar denominator allows all benefits to be 
aggregated and climinates the need for weights in aggregating and valuing 
outputs. When effectiveness is evaluated using test scores, responses to 
surveys, or other point score measures, this poses a problem in terms of 
evaluating the validity of alternative measures because the judgements 
as to how to aggregate the indices are subjective. It also makes compari- 
sons across countries based on different indices virtually impossible. 

An ideal study of effectiveness, descriptive or mathematical, should 
have at least four structural elements; (a) a well-defined set of outputs 
to be measured; (b) a predetermined strategy for evaluating the output 
measures; (c) a representative set of programme participants and; (d) an 
adequate control group against which the effects of an activity or set of 
activities can be measured. These elements are usually present in effec- 
tiveness studies in varying degrees. At issue is the question of how the 
absence of one or more of these affects the validity of cross-project 
comparisons. : : 

Careful definition of the output set is important in measuring effec- 
tiveness. This can be undertaken by specifying a set of measures that 
would capture all of the major outputs of an educational project. However 
not all of these are known in advance. Thus, it is uscful to begin with a 
pre-test or a set of case-studies to provide information on project benefits 
not recognized by planners. 5 

Case-studies, an approach often favoured by anthropologists to 
evaluate programme impacts, provide the analysis with a depth that is 
often lacking in other approaches. The interviewer is able to focus atten- 
tion on a single family or a limited number of families. Properly trained, 
he or she provides a detailed and comprehensive insight into a pro- 
gramme's effects that is often lacking when a project's outputs are 
measured through a less time-consuming method. The interviewer has 
the advantage of getting to know the family. This may breed trust and 
may also increase the reliability of the data. Especially in developing 
countries where distrust of outsiders and regional dialects hamper the 
flow of information, the case-study provides as reliable data as one is 
likely to obtain from on-site data-gathering. A 

What makes it difficult to use a case-study approach for effectiveness 
analysis is its limited representativeness. To be useful in project design, 
an effectiveness study should provide information that is applicable to 
the entire population the project serves, not simply to selected segments. 
While it is possible that a study of ten families may be reasonably rep- 
resentative, in the absence of suitable weighting procedures, the results 
obtained by this procedure are often not useful in choosing among proj- 
ects. Differences in interviewer perceptions, the inability to weight the 
results to reflect the target audience, the failure to include representatives 
of all the various groups of listeners, and the inherent subjectivity of the 
output measures call into question the usefulness of case-studies for project 


selection purposes. 
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A related difficulty with the case-study is the absence of quantitative 
measures. The interviewer frequently records a set of impressions. There 
is a book in the house. A new latrine exists in the back. The family has a 
compost heap. These items can be used as quantitative indicators if all 
interviewers are told in advance to look for them. But their usefulness as 
effectiveness measures is limited. 

Of crucial importance to effectiveness analysis is the presence of a 
meaningful control group. The best control is a group of persons who have 
not been exposed to either this learning activity or to suitable alternative 
sources of learning. Where a project is small and has been in existence for 
a short time, it is relatively easy to compare the learning levels or social 
progress of an ‘affected’ group with that of an ‘unaffected’ group. Where 
the project has been in existence for many years, as in the case of the 
Colombian radio schools, and/or where it is national in scope, it may be 
difficult to find an ‘unaffected’ control group.! There are several aspects 
of this problem which warrant study. 

An educational project exists in a time dimension. Education takes 
time to deliver, time to absorb, and time to extinguish; its real effects are 
likely to be revealed only after a period of time. Presumably, the analyst 
should take timing into account in measuring effectiveness over the long 
term for the same reasons that we use a discount procedure to value 

costs. In the absence of concrete measures, such as the effect of education 
on earnings streams, the problem is how to capture these time effects. 

A current measure of effectiveness takes into account the total 
learning that has gone on since the inception of a programme less the 
amount of learning that has been lost due to ageing, other physical 
factors, inability to reinforce earlier learning due to environmental 
constraints, etc. For a programme which has been in existence for a 
short time, this poses no serious problems. However, for the long-term 
project, say, one which has been in existence for ten years, it is difficult 
to interpret the meaning of a positive outcome. If it is viewed solely as 
the result of the current level of training being offered, then this implicitly 
assumes that the value of past training is zero. On the other hand, if it 
is the sum of the current education plus some discounted value of past 
experiences, what is the appropriate way to weight past and current 
learning to render them comparable? This problem is further com- 
pounded where an attempt is made to compute a cost-effectiveness ratio. 
At this point, the issue of the time duration of the effectiveness measure 
must be confronted directly.? 


A related problem, which exists, in part, because time cannot be 


1. This is particularly true for a project like Radio Santa María in Colombia which 
has been in existence for thirty years. The key problem is not that an unaffecte 
group cannot be found but rather that it is difficult to know how a group is affected. 

2. If the effectiveness measure captures the cumulative effects of a programme, then 
its cumulative cost should be used in the denominator in forming the ratio. The 
issue then arises as to how many years of cost are applicable. 
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held constant, is that some persons are exposed to other learning experi- 
ences than those of the project and these may have a substantial influence 
on the cffectiveness of the project. 

It is not the exposure to other educational experiences in itself but 
rather the difficulty of identifying these episodes that is important. 
Without proper identification of these exposures it is difficult to know the 
target against which the effectiveness of a programme is being judged. 
Ideally, it is possible to compare the participant group to those with no 
alternative education, or to those with a common level, i.e. three years 
in first-level schools.| But in many developing countries a variety of 
organizations exist to help people in rural areas. Some of these are 
sponsored by the government and some by private agencies. In both 
instances data on where rural programmes are currently under way (and 
where they were previously under way) can be extremely difficult to 
obtain. Under these circumstances, the opportunities for the researcher 
to obtain an acceptable control group may be severly limited. 

The conceptual difficulty this raises can be illustrated using a rela- 
tively simple model of what determines the educational outputs absorbed 
by an individual at a point in time. Each symbol in equation 1 presents 
a vector of measures for each of the individuals affected by a particular 
project. For the sake of simplicity, the only notation used in the equation, 
t, denotes the time period. 


0, = F(0,-4) En V, U) (1) 


O, is the measured set of outcome for a project at time f, O,. , is the 
measured set of outcomes from previous periods, Æ, is the influence of the 
input mix employed by a project, V is the impact of all other context 
variables and U, represents all other variables that cannot be identified. 

In order to provide a measure for the effectiveness/cost ratio, as a 
first requirement, the incremental change in O, due to the incremental 
change in Æ, must be identified. This is not an easy task. If O,_, cannot 
be isolated, the value of O, will shift for reasons unrelated to the other 
variables. As a result, the cffect of E, estimated through this procedure 
will be biased. The same results will occur if the effects of the V variables 
are ignored. p H 

This formulation provides what economists call a production func- 
tion. With the appropriate specification of the programme outputs, 
defined either in terms of cognitive achievements or impact outcomes 
(such as a change in productivity or in the income of participants), the 
effects of an educational programme can be measured. However, the 


1. Our comparison here is with the formal school. Where the purpose is to ascertain 
how an educational project affects practical knowledge, a number of variables 
intervene such as how a piece of knowledge is reinforced, the attitudes of parents 


and friends, etc. 
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cquation makes clear that control variables are needed to account for 
environmental factors. These variables can be included only if an 
acceptable control group is available to the researcher. 

Given the complexities inherent in the learning process, it is difficult 
to get a realistic estimate of the effects of an educational project without 
using the production function approach described above. Unfortunately, 
few studies in developing countries have succeeded in isolating the 
various controls called for in the model. Not only are such data expensive 
to obtain but the absence of historical records from the operating agencies 
make the V terms virtually impossible to estimate except through the 
recall of the programme participants themselves. While the use of a 
recall measure is better than the use of none at all, it is unlikely that the 
recall method is sufficiently reliable to capture major past influences. 
This is because the interviewer is left with the task of defining what 
these alternative educational exposures might have been and with the 
unenviable problem of rendering alternative educational exposures com- 
parable. For these reasons the control group remains one of the most 
intractable difficulties in effectiveness analysis. 


Three measures of outcome 


Even in countries with highly developed educational systems, a confusion 
exists as to the level of effectiveness at which a project should be evalu- 
ated. At least three levels can be identified. In the case of the first level, 
effectiveness is defined in terms of the number of students reached, in the 
second in terms of the new skills acquired, and in the third by the extent 
to which behaviour is altered by the educational project. These are 
fundamentally different measures, whether one deals with the complexity 
of the measure, its composition, or its implications. Since all three have 
been utilized in the literature it is useful to consider them in some detail. 


A target measure of outcome 


The first measure is based on the concepts of target and actual audience 
developed elsewhere.! A project administrator selects or is assigned à 
target audience. After the project is implemented it reaches some fraction 
of that audience between o and 100 per cent. The closer it gets to the 
latter percentage the more intensively it is operating and the more 
efficient it may be considered in reaching its intended audience. 

Using this criterion, it is possible to measure the effectiveness of the 
formal schools in terms of the difference between the actual number of 


1. H. Tuckman and T. Nas, Educational Technolog y in Developing Countries: The Allocation 
Issue, Washington D.C., AID, 1978. 
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students the schools have in average daily attendance and the potential 
number. Likewise, in an instructional radio context, the comparable 
measure might be the difference between the number of potential 
students in the target population and the number of students actually 
reached. In either case, the difference is expressed as a percentage of the 
potential audience. 

Such a measure is preferable to a measure based on actual audience 
participation since the latter favours projects with large numbers of 
participants, as in studies which use average cost measures.! 

A target measure of effectiveness has several other advantages. It 
involves delineation of the regions, age groups, sex, and other charac- 
teristics of the target group. Once the appropriate groups are defined, 
data can be obtained from the Clensus Bureau, or by survey. In the 
process of developing the measure, the question of which elements an 
organization should serve will almost inevitably arise, especially if it 
turns out that the project is reaching a large number of non-targeted 
persons. : 

By this measure, the best project is the one which reaches the largest 
percentage of its target audience. A project which defines its population 
too broadly or which fails to capture the interest of its listeners is penal- 
ized. Of course, it is possible for a project administrator to make his 
project look more efficient by selecting a target audience which is easy to 
reach. However, there are limits to his ability to do this. The target 
measure also gives rise to an optimal decision rule. Given two projects, 
the one preferred is that which is able to reach a higher percentage of its 
potential audience per dollar of output than the other. : 

As might be expected, a target measure of effectiveness is vulnerable 
to criticism precisely because of its simplicity. A definition of effectiveness 
based solely on presence is indeed a narrow one. In a classroom context, 
the presence of children in a learning context does not mean that the 
children are listening, or learning. In an instructional radio setting, the 
fact that a radio set is on does not mean that it has the attention of the 
people in the room. Presence is not synonymous with absorption and 
should not be treated as if it were. : kee 

A second criticism of the measure is that it takes the project’s defi- 
nition of the target audience as the desirable one. While it may be true 
that a particular project is targeted at the most suitable audience, the 
possibility also exists that it is not. Suppose, for example, that project A 
is designed to provide elementary training 1n literacy while B is focused 
on providing job skills. In a labour market where more persons are 


i i i have 
1 I i country like the Republic of Korea will appear to 
a My eliclent eE even ifit uses a costly technology because of the large 
opulation to which the technology is applied. — 
2. Dr suc Fore is that efficiency is the sole criterion. As we shall argue later, 
equity considerations also enter into the decision process but it is best to allow 
this to be done through explicit trade-offs between equity and efficiency. 
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needed with job skills, B may have greater value than A En A ie 
the perspective of society. Use of the target measūre s obs ind 
regard to other socially defined criteria might lead to t S vaa ets 
even though B yields larger social returns. In this ers "A dior 
measure yields an inefficient choice because it ignores the va 

i i ht. 

i "e ee hand, many project studies are conducted ex 2 det 
and are intended primarily to provide an indication of how "s Ava 
these have reached their intended audience. In this context, t ek p 
criticism is irrelevant and the target measure is useful in ps 
idea of the ‘slack’ of a project; that is, of the distance that a pr car 
to go to obtain optimal coverage. This measure can be iors ae uet 
programme administrators to see where they can increase the 1 

of participation in their programme. 


Achievement measures 


A second set of measures of effectiveness involves the use of one or A by 
achievement test to determine student performance. Usually bue e "d 
using both an experimental and a control procedure, this metho ot 
vides information on whether the participants in an educational P is 
are learning more than those who do not participate. This SPEI ho ols 
frequently employed in cost-effectiveness evaluations of the for mal this 
and has found its way into several instructional radio studies. ky 
level, the focus is on the development of a set of skills, not on the u 
these skills in daily living. R dures 
In the developing-country context, a variety of testing proce 

have been utilized, som 
in the Radio Mathemat he first 
her colleagues used three means of evaluating achievement.? In t 

phase of their project, 
at which it was possib 
and the extent to whic 
last part of the school y 


information about competency before 


en to the radio programmes. M 
In contrast, White? used median examination scores on Sb 


Hd eS, 
4 Pre " cienc 
ject examinations—language, grammar, mathematics, natural s 


sub- 


I. See, for example, E. M. Rogers, J. R. Braun and M. A. Vermilion, ver it 
Forums: A Strategy for Rural Development’, in Spain et al., op. cit., Chap r 


$ ject » 
2. B. Searle, P. Suppes and J. Friend, ‘The Nicaraguan Radio Mathematics Pro® 
in Spain et al., op. cit., p. 28, ^ 
3. R. A. White, 4n Alternative Pattern of Basic Education: Radio Santa Maria; 
Unesco, 1976. (Experiments and Innovations in Education, 30.) 
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Dominican economy and social studies—to compare the performance of 
grade-6 students in schools using radiophonic and conventional classroom 
methods in the Dominican Republic. The wide range of possible achieve- 
ment measures, and their similarity to the testing methods that we are 
accustomed to, make these measures popular among researchers. 

The education profession itself has questioned whether performance 
tests are the best measures of educational output. The criticism of 
achievement-based measures of outputs usually involves one or more of 
the following arguments; the measures are slanted toward the value 
structure of the person constructing the test, the measures do not 
adequately reflect the weights given to the material by the instructor, 
the measures do not measure the student’s ability to analyse or retain 
but rather to memorize, the tests are culturally imbedded, the tests are 
administered in too short a period of time.! While most of these criticisms 
apply in the developing society context, they pale beside the problems 
involved in collecting reliable achievement data on a large-scale pro- 
gramme such as Movimento de Educagüo Basica in Brazil or the Popular 
Promotion Movement in Honduras. , 

Achievement test measures are also criticized because the conclusions 
reached about the effectiveness of a project or set of projects are not 
invariant to the testing procedure used. A test with a large number of 
questions is likely to show a larger point score increase than a test which 
consists of few questions. Likewise, a test with ‘easy questions will yield 
both a different mean and a different distribution of responses than one 
which is ‘hard’. While these objections are not damaging if the same test 
is used to evaluate alternative projects, they are very telling for cross- 
country comparisons of radio school projects. In the latter instance, 
serious comparisons are impossible if different test procedures are used. 

A related argument involves the question of how to weight per- 
formance on the different achievement tests. I ] 

A set of output weights can sometimes be obtained from project 
planners or administrators. But the weights developed from these sources 
may differ from those of the society as a whole. Moreover, unless all of 
the tests use similar questions and tests for the same forms of learning, it 
is questionable whether they can_be added together to provide an 
aggregate measure of effectiveness. It can be argued that while a project 
has several outputs, the effectiveness measures and cost of each output 
should be presented separately and no aggregation should be attempted. 
None the less, some researchers are likely to be unable to resist the temp- 
tation to evaluate an educational project using a single aggregate index. 


1. An interesting discussion of several of these issues appears in E. M. Gramlich and 
P. R. Koshel, Educational Performance Contracting, Washington, D.C., Brookings 
Institute, 1975. Note especially Chapters 4. and 6. The elements of construction 
appear in N. E. Gronlund, Constructing Achievement Tests, Englewood Cliffs, N.J., 


Prentice-Hall, 1968. 
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Finally, because no uniform and widely available set of achievement 
tests is available to researchers, it is likely that educational projects will 
continue to be evaluated in terms of different achievement measures. 
This will make it difficult, if not impossible, to compare the effectiveness 
of individual projects. Achievement measures are likely to continue to 
be most effective where they are utilized in a context where the same 
measures can be used to evaluate several projects. 


Behavioural measures 


Measures of the behavioural changes brought about as a result of an 
educational project are designed to capture those elements of learning 
which get translated into concrete action. These are probably best suited 
for evaluating the effects of multiple output projects and of projects 
involving changes in ‘the nature of man’. More subjective than achieve- 
ment measures, behavioural measures are a step removed from the 
learning process; they are also more likely to be sensitive to the effects of 
external variables. That the two measures are not the same has been 
documented by Levin, and the low correlation between achievement 1n 
school and career progression has been demonstrated by Jencks.! To the 
extent that effectiveness is measured in terms of the behavioural outcomes 
of à project rather than through achievement scores, the results obtained 
using the former measures are likely to diverge from those obtained using 
the latter. 

Which of the two measures is preferable depends on whether the 
goal of a project is to raise achievement levels or to change behaviour. 
A knowledge that a particular educational project raised reading scores 
10 per cent while another raised them 5 per cent does not necessarily 
mean that the former was more effective than the latter if the purpose 9 
the Projects was to enable the programme participants to utilize their 
skills to read the n wspaper. Similarly, a programme designed to teac 


Although these models or the 
emphasis, generally they have att i caton 
through radio schools with a on a ean alt Pali D 

organization which is intended 


1. H. Levin, ‘A Decade of Policy Developments in Improving Education and Training 
g ty Policy 


for Low Income Populations’, in R. Hav j- 
z : oun & Haveman (ed.), A Decade of Anti-Pover' 
Achievement, Failures, and Lessons, Chapter 4, Ne s resi dos Press, 1977: 
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interest-group formation. The learning of specific skills such as literacy is 
seen not as an objective in itself, but as the medium through which there is 
created an awareness of community problems or social and political injustices 
that are assumed to be the real factors in underdevelopment. The general 
objective is also frequently described as desarrollo integral, integral development 
which takes into consideration all major dimensions of human personality. 


Effectiveness is measured in this context by a different set of criteria 
from those used to capture achievement. Mastery of any single skill is not 
sufficient to accomplish the goals of integrated education. Instead, success 
is achieved when the participants in an educational project develop a 
level of awareness which, in turn, is translated into a concrete set of 
actions. Presumably, such awareness may be created through several 
different types of instruction. However, the common characteristic of all 
of these is that they are directed toward augmenting their participants" 
abilities to cope with real world situations. The choice of measures to 
determine the effectiveness of this type of education thus rests on a prior 
concept of what behaviours the ‘aware’ participant should engage in. 

In contrast to the achievement measures, those which are based on 
behaviour capture what the participant does, not what he or she thinks. 
Behaviour may be easier to measure than learning since what people do 
is often observable while what they learn sometimes isnot. Ifa programme 
is designed to promote community organization, its success can be judged 
by how many persons have joined a community organization; if its goal is 
to encourage its participants to save, the success of the programme can 
be j udged on whether the savings rate increased. j 

The behavioural measure involves a more complex set of behavioural 
responses than the achievement measure and as a result it lays down a 
more stringent measure of effectiveness. For behaviour to change, the 
following conditions must exist; the person must participate in the project, 
he must understand and absorb the message the project is trying to 
convey, he must agree that some of the proscribed behaviours are ‘good’ 
or that they are at least worth trying, and he must actually try them. 
Particularly in the case of the latter two steps, strong internal constraints 
may exist which a project must overcome. Thus, it is not surprising that 
some earlier studies have found organizations less effective when a behav- 
ioural rather than an achievement measure is used.? 

Virtually no limits exist to the types of questions that can be asked 
to uncover changes in behaviour, especially in projects which deal with 
the development of a ‘new’ man. Measures can be formulated to deter- 
mine the participant’s ability to use a tooth-brush, knowledge of the 


1. R. A. White, in Spain et al., op. cit. d " d 
2. Compare, for erase, S. F. Brumberg, ‘Colombia—A Multi-Media Rural Edu- 


cation Programme’, in Education for Rural Development—Case Study for Planners, 
New York, Praeger Publishers, 1975; with S. Musto, Los Medios de Communicacién 


Social al Servicio del Desarrollo Rural, Bogotá, Editorial Andes, 1971. 
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health-giving qualities of milk, ability to care for an animal, skills in 
trade, etc. A project evaluator is faced with a large number of judgements 
regarding how many questions to use to validate changes in each type 
of behaviour, the weights to give to each type of behaviour, and whether 
to measure for the intensity of an action or solely for the existence of an 
action. The final set of questions provides an indication of the researcher's 
(or the organization’s) view of what behaviours a properly educated 
person should exhibit. 

Presumably, those types of behavioural change are desirable which 
move the project participant in a direction that a moral and well- 
intentioned educated person would follow. None the less, not all 
behavioural changes are alike either in intensity or in consequence. A pat- 
ticipant may learn to boil water or to brush his teeth. These are desirable 
activities because they have an impact on both health and life-style. 
Both involve a one-time level of awareness, however. Once the lesson 
is absorbed, presumably no further education is needed on how t9 
accomplish the task; repetition may be useful to reinforce the newly 
acquired behaviour but not to convey new knowledge. 

In contrast, teaching a participant to engage in community- 
organizing activities may require several years. Both the magnitude of the 
teaching task and the benefits of this type of learning differ substantially 
from the behaviours described above. An effectiveness measure designe 
to capture this type of behaviour can take many different forms. It may 
focus on the one-time question of whether the person ever engaged in this 
type of activity or on the intensity of the person's activity. In either case 
pi substantial room for discretionary differences among researchers: 
ional gul rues ay temple, that two researchers evaluating is 
onek c Herent countries will use the same tools. As a res al 
measures wd Merino “ educa tional projects using hekaviot i 
compared. y to involve behavioural measures which are not eas 
menes a ip oies of many educational projects, behaviours 

tudies. Since they provid nue to be favoured in many pec 

they span a bee Sch aine and ice cine ii wr use 

in effectiveness-onst fact outputs, these measures are well suited for t 
alysis. However, substantial development Wo 


— to be undertaken to arrive at a set of effectiveness measures whic 
can be used in cross-country comparisons 


Aggregate economic measures 


In addition to the three meas 
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tiveness of a project in its own terms than for capturing the overall effect 
that the project has on economic development. They are also often used 
to explore how the project contributes to the upgrading of the lower 
income groups in a society. 

Four types of measures are usually used to evaluate economic impact. 
These deal with the productivity, mobility, accumulation, and income 
distribution effects of a project. While the literature in the field of econ- 
omic development is fairly extensive, studies on the use of these four 
measures for evaluation of educational projects are only now beginning 
to appear. 

Several different types of productivity measures have been used to 
measure the effectiveness of educational projects. The most frequently 
found set of studies of this type examines the impact of formal education 
on earnings.! An earnings measure is frequently favoured by educational 
economists because it utilizes data that are comparatively easy to acquire, 
requires relatively little analytic sophistication to construct, and usually 
produces fairly sophisticated results which can be used to compare the 
rate of return on education to the return on other forms of investment. 
Thus far, this approach has not been well developed for non-formal edu- 
cations because of the low level of earnings of the population served and 
the difficulties inherent in translating non-monetary incomes into a mon- 
etary equivalent. It is also difficult to forecast future earnings, a necessary 
step for rate-of-return analysis, because of the uncertainties inherent in 
subsistence farming.? a 

An alternative productivity measure favoured by Griliches and 
several other economists involves the use of an education measure in a 
production function for agriculture to estimate the contribution that edu- 
cation makes to agricultural output.? A production function relates the 
inputs used in a particular industry to the outputs. So far, comparatively 
little has been done to study the role of instructional radio or of other 
non-formal methods of augmenting agricultural productivity. Through 


1 B H 4 
time, morc of these efforts are virtually certain to come. 


1. M. Carnoy, ‘Rates of Return to Schooling in Latin America', Journal of Human 
Resources, Summer, 1967, p. 359-745 and C. Jencks et al., Inequality, Ncw York, 
Basic B 3 

2. While a diede may also be generated from the sale of crafts, from the 
production of bread or other items, or from trade, for the majority of the popu- 
lation in rural areas they are agricultural. As such they depend on geography, the 
insect population, and a host of other cvents determined by nature. 

3. Z. Griliches, ‘Notes on the Role of Education in Production Functions and Growth 
Accounting’, in W. L. Hansen (ed.), Education, Income, and Human Capital, New York, 


Col i i i ' o. ^ 
4 M. paeem m = ale: and L. J. Lau, ‘Farmer Education and Farmer 
é rocessed paper, Washington, D.C., 


Efficiency: A Review of the Literature’, unp : LY J 
1978. See also M. R. Rosenzweig, ‘Farm-F: ‘amily: Schooling Decisions: Determinants 


of the Quantity and Quality of Education in Agricultural Populations’, Journal 
of Human Resources, Winter, 1977; P- 71-91- 
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Education can have a significant effect on the distribution of the 
population between rural and urban areas. In a study of Radioprimaria 
in Mexico, Spain found that: 


A consistent desire for education came out, but with it came the conviction that 
education is a vehicle by which to escape the rural area. The rural people do not 
feel that their area was ‘developable’, only that some children could develop 
themselves enough to go elsewhere. Elsewhere means the city of San Luis 
Potosi. The rural people believe that better job opportunities await them there 


if they come with their primary certificate in hand. Yet that many jobs do not 
exist? 


As this quote illustrates, in a country with limited positions for the semi- 
educated, the impact of education may be to create unemployment and 
dependence ifit causes migration to the cities. The administrators of many 
instructional projects have recognized this problem and some try tO 
encourage their participants to remain in rural areas. The issues sur- 
rounding the question of whether urban migration is a positive or negative 
force for change are complex and depend to a large extent on the nature 
of the country. It is sufficient to note here that because of the importance 
of this variable some studies have treated it explicitly in evaluating pr oject 
effectiveness. 

, Measures of accumulation constitute the third broad class of econ” 
omic aggregate measures. Perhaps the most important of these involves 
the rate of capital formation. Capital formation is a much more significant 
determinant of growth in a developing country than in a developed 02° 
because of the existence of under-utilized labour. As the amount of capital 
available for production increases, the output level of the society and the 


number of jobs it can sustain may increase as well. To the extent that 
education increases savings, t 


1. Spain, op. cit., p. 69. 
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Income distribution measures represent the last category of aggregate 
economic indicators. Economists are careful to distinguish those effects 
which involve the efficiency of a project from those of an equity nature. 
Distributional effects involve equity considerations and, in this sense, 
they represent the most subjective of all of the effectiveness indicators 
considered in this paper. They address at least three major questions: 
Which income groups pay for a project and which are the recipients? To 
what extent does participation in a project change a person’s position in 
the income distribution relative to his position if he had not participated? 
To what extent does a project change the distribution of income at the 
regional or community level? 

Income distribution effects should not be combined directly with 
measures of effectiveness.2 An efficient project is one which raises a 
society’s total output. How that output should be distributed involves a 
set of judgements which are unrelated to the efficiency of the project. 
This does not mean that equity effects should not be considered in 
choosing among alternative projects. On the contrary, it 1s exceedingly 
useful to present decision-makers with a set of cost-effectiveness ratios and 
a set of likely income distribution measures for the projects under 
consideration. In the final selection process decisions can then be made 
regarding the trade-off between effectiveness and distributional effects. 

Comparisons among projects conducted in different countries are 
particularly difficult to make when distributional issues are involved. 
This is because it is difficult to compare changes in two distributions 
when these distributions differ. Is it ‘better’, for example, to have 2 per 
cent of the population move from an income of US$200 to $300 in a 
country where ro per cent of the population have incomes in excess 
of $10,000 than to have 2 per cent of the population Bone from $200 
to $400 where 20 per cent have more than $10,000! A number of 
variables are likely to influence a judgement involving the income distri- 
bution consequences of alternative projects. In some instances these may 
be inconsequential, as in the case where comparisons of the mode of 
financing educational projects have been made cross-country. In 
others, it is virtually impossible to make meaningful statements, as in 
cases where large regional differences emerge 1n the effectiveness of a 
project. 


Income distribution indicators are important and they belong in 


1. For an excellent discussion of this, see A. M. Okun, Equality and Efficiency: The 
Big Tradeoff, Washington D.C., Brookings Institution, 1975. à 

2. "This ee Qu parallels the one used in benefit-cost analyses. It is not 
valid to try to capture equity and efficiency impacts in the same measure since 
the former net to zero in the aggregate while the latter have a positive or 

i domestic output. OMEN i 

3. Se. y. pem aoe Expenditures on Education and Income Distribution in Colombia, 

Baltimore, Md., Johns Hopkins Press, 1974. (World Bank Occasional Paper, 
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studies of the effectiveness of educational projects. They should be used 
cautiously, however, and with care in interpretation; they should not be 
directly incorporated into an aggregate measure of effectiveness. 


Is there a best measure? 


It should now be clear that no single effectiveness measure captures the 
various ways in which the effectiveness of an educational project can be 
evaluated. A measure which compares actual participants with target 
participants serves a useful purpose in indicating the extent to which a 
project is reaching its target group. It also provides an external check of 
whether a programme is working close to capacity or whether it 1s 
reaching only a limited portion of its potential audience. Likewise, 4 
measure based on achievement scores provides quantitative data on the 
extent to which a project succeeds in conveying a set of skills. Even if the 
goal of that project is to Provide an integrated education, it may be 
useful for comparative purpose to be aware of how effectively it delivers 
the skills that its Participants are expected to integrate. i 
Similarly, it is helpful to know how a programme alters behaviour 
even if it defines its goals purely in learning terms. A programme design ed 
solely to augment literacy or mathematics skills may none the less create 
unintended by-products. Its participants may use their new-found skills 
to read about the care and feeding of animals, to obtain news about 
friends from a local newspaper, and/or to engage in religious studies. 
change in behaviour which results from an educational project, whether 
Positive or negative, is a valid output of the project and a well-constructe 
; change into account. : 
While there are good reasons for espousing the use of multiple- 


TABLE 1. Project selection given three alternative effectiveness measures 


Effectiveness/cost ratio 


F aG 
Project A Project B Eroi 
Target audience 0.8 0.6 0.3 
Achievement score 30.0 : 20.0 


Behavioural measure yo: 
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What Table 1 illustrates is that the ranking given to a particular 
project may depend upon which effectiveness measure is chosen. As 
shown, each measure is based on a different scale; thus, the separate 
measures are not easily aggregated.! One cannot argue, for example, 
that since the achievement score index has the largest value it should be 
given the greatest weight. Likewise, it cannot be argued that since 
project B has the greatest point spread difference in achievement scores 
it is the most desirable one. In this instance, the decision must be made 
on the basis of which measure most accurately reflects the goals the 
project is designed to fulfil. 

Having examined several of the problems associated with con- 
structing effectiveness measures, we turn now to the issues involved in 
acquiring the data needed for constructing these measures. While many 
of these problems are probably familiar to practitioners in the area, this 
type of exercise is useful in highlighting the uncertainties associated with 
effectiveness measures. 


Alternative ways of collecting data 


Several methods are available for gathering information to construct 
effectiveness measures. These are considered in this section. The ques- 
tion of which is the best method depends on the nature of the effectiveness 
problem and the environment in which the educational project operates. 


Data gathering by survey 


This procedure involves gathering data directly from the population the 
programme is intended to reach. Usually questions are asked involving a 
set of control variables and a set of quantitative measures of outcomes. 
These may include achievement scores, questions concerning the person’s 
opinion of the effects of the educational project, etc.* i . 
The level of detail or specificity of the questions 1s determined either 
in isolation or preferably as a result of case-studies conducted in selected 
regions. In either case, supportive information with respect to the socio- 
economic characteristics of the various regions should also be obtained. 
Though this technique is extremely useful in obtaining information 
directly from programme participants, 1t has several limitations. First, 
there is the problem of sampling. Since there are usually no data available 


1. It is possible, of course, to utilize a scale which renders the three measures equiv- 
alent or to design a single measure which contains indicators for each of these 
levels of effectiveness. This does not avoid the weighting problems discussed 
earlier, however. 
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on the actual population of a large educational project, it is pos 
draw reliable generalizations based on data drawn from a sanp id et 
the data may be highly reliable, it is not certain that they axe or ges 
tative of the target population. Usually no simple way exists to v 
ey due to regional differences, a single instrument wio 
utilized in a whole country may produce an ineffective and wee dd va 
set of data. It is possible to avoid this problem by designing ee 
specific questionnaires. However, this is likely to be a costly os ed 
consuming procedure and it makes the final measures di cn 
aggregate. A preferable procedure is to use a pre-test of the poda this 
to identify questions that are applicable to all of the regions. kof 
narrows the scope of the inquiry somewhat, it greatly reduces d un 
making aggregate statements about a programme. The risk int * E 
cedure is that it may introduce a bias into the analysis by a for 
major problem areas or by providing data which are less reliable 
some regions than from others. ; "m 

A third problem relates to the accuracy of the participants duum us 
The high illiteracy rate in the rural areas makes it difficult for pa hich 
pants to respond accurately to written questions, particularly those ode 
involve fixed responses. Of equal importance is the difficulty in ee fare. 
reliable information related to the participants’ property and we eto 
Some respondents will be reluctant to divulge information of this TE ply 
outsiders, some will not understand the question, and some will si ‘ons 
not know the answers. If the analysts are trained in how to ask ee m 
this problem will be lessened but it will not disappear. It is also rot 
for the interviewers who administer the instrument to spend time ore 
the interviewees so that their observations and the participants m 
trustful feelings will reduce the danger of incorrect responses. 


Data from programme administrators 


raal 
When field surveys are not feasible because of time, budget, or politics 
constraints, it is often possible to obtain information from a program?" a 
field staff. These staff are often a useful source of data both on BoY i 
project actually operates and on whether it is teaching its target POF y 
lation. However, the possibility exists that the information provide 
the staff is biased in favour of the organization's stated objectives. 
this case, the data may not reveal what the organization actually | for- 
Second, the programme staff may not be willing to reveal s rue 
mation on the negatives of the programme. This will be especially an- 
if divulging such information will affect their own position in the orgs. 
ization. For these reasons, data of this type are not normally us¢ 


B Š E ined: 
constructing an effectiveness/cost ratio. If no other data can be obtait 


: : i 
it may be preferable to report these data as illustrative but to 2V° 
direct comparison of effectivene 


Ss and cost. 
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Data from national and international agencies 


Aggregate indicators of literacy, health, income and income distri- 
bution, etc., compiled by national or international agencies, can some- 
times be used in effectiveness analyses at the aggregate level. This is 
particularly the case where projects have large national audiences and 
where their goal is to alter specific social indicators, i.c. to reduce illit- 
eracy. There are several difficulties, however. The primary one is that it 
is hard to untangle the effects of one organization from those of another. 
Rarely, if ever, are indicators available which cover the activities of only 
one educational project. Second, the information obtained from these 
reports may not be comprehensive or complete enough to be useful in an 
effectiveness study. Unless suitable controls are introduced, cross-country 
comparisons are likely to be too crude to yield meaningful data on the 
value of alternative educational projects. 


Use of other countries’ experience 


Effectiveness studies of the educational projects operating in other 
countries provide operating experience and some insight into the problem 
associated with introducing a new educational technology. But they 
should not be the sole basis for deciding what type of project to adopt. 
The goals of a project are likely to change as it is shifted from one 
country to another. For example, an instructional radio project may aim 
to reach the adult population of one country whereas it may be suited to 
supplement the public schools in another. Thus, the effectiveness criteria 
on which each project would be judged would differ. Even if the edu- 
cational projects of two countries are similar in terms of structure and 
goals, they may still produce different effects because of environmental 


differences. It is essential that a country relying on the experiences of 
other countries in selecting among educational projects pay careful atten- 
al and economic characteristics 


tion to the question of how its own soci 
might affect these projects. 


Conclusions 


The discussion in this chapter suggests the substantial difficulties inherent 
in acquiring a suitable effectiveness measure. Problems exist in defining 
the level at which effectiveness should be measured, in defining the 
elements that enter into such a measure, and in obtaining data that will 


be both reliable and valid for measurement purposes. Serious problems 
also exist in attempting to aggregate the various outcomes to define an 
eness. These problems are somewhat lessened 


overall picture of effectiv: e E 
when the sole purpose of the analysis is to determine whether an edu- 
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cational project makes a difference; that is, whether the a a 
a project have a higher level of proficiency in a given area than icem o 
participants. The problems are most acute when there is a need n cree 
a cost/effectiveness ratio by which the alternative projects can be judg of 
For these reasons it is hardly surprising that the vast majority : 
effectiveness studies pay homage to the concept of o m 
analysis but fail to practise it in reality.! Most such studies provi oe 
limited number of measures usually based on achievement and ni 5 
ignore both the aggregation problem and the issue of the level at ipn 
the analysis is to be conducted. While we offer no simple cer ilie 
these approaches, we do believe that a careful study of wenig apri 
should include measures directed at the several levels discussed eh en 
chapter. By providing data of these types, the researcher allows tho 


= H . mnm . ;. ia for 
persons concerned with project selection to utilize their own criteria 
selection. 


The use of health statistics as an 
effectiveness measure in certain 
development communications projects 


Joanne Leslie 


Introduction 


second section, a paradig" io 
of mass-media health and nutrition educ 


in TOE 
1. For a critique of these Studies, see: M. Carnoy and H. Levin, ‘Evaluatio? g, 
Education Media: Some Issues’, Instructional Science, 1975, Vol. 23, No. 2, P- 207 


Results and problems 
87 


projects is developed. In the third section, three health sector develop- 

ment communications projects that have included health outcomes as 

one measure of effectiveness are described. In the final section, the advan- 
tages and disadvantages of using health statistics to measure effectiveness 
of mass-media health and nutrition education projects are summarized. 

The assumptions underlying the use of mass media for health edu- 
cation have typically included the following: 

Mass media can reach large numbers of people in a short period of time; 
the use of mass media is particularly valuable for reaching people 
in sparsely populated or relatively inaccessible regions. 

Where competent professionals are scarce or concentrated in the urban 
centres, the mass media may provide the only way that professional 
advice can be distributed throughout the country. 

Costs per person reached can be quite low, particularly in the case of 
radio or newspapers where the media are usually already in place. 

An additional assumption underlies the use of the strategy of non-formal 

education to improve health and nutrition; this assumption is that poor 

health in the community is due to a lack of knowledge or a poor attitude 
as well as to a lack of resources. : 

There are also certain common assumptions made concerning the 
disadvantages of using mass media for non-formal education; the most 
frequently cited are the following: 

The educational message cannot be individualized so the mass media are 
limited to issues for which the same advice is appropriate for many 
people. 

The mass media usually have lower credibility than interpersonal 
communication. 

The possibilities for interaction or feedback are limited. 

Considerable experience has already been accumulated (from both 

research and non-research projects) with the use of mass media for health 

sector development. Mass-media non-formal education projects in health 
and nutrition have been diverse and imaginative; the following are just 

a few of the more interesting examples: 

A one-year campaign in the mid-1960s by the Mexican Consejo Nacional 
de la Publicidad to prevent accidents [1].1 

A poster campaign, which began in Zaire in 1962 to teach nutrition and 
prevention of malaria, intestinal parasites and tuberculosis, and 
which now distributes health material to fifteen African countries [2]. 

A six-week campaign in 1974 by the Housewives’ Association of Trinidad 
and Tobago using radio, television and newspapers to promote 

-feedin . 

A a. vos d EN called the Senior Chef, which were pro- 

duced in Canada in 1972 to teach nutritious and economical food 


preparation to the elderly [4]. 


1. The figures in brackets refer to the references at the end of this article. 
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Although there have been many projects in which the mass eir 
been used for non-formal education in health and nutrition, tey me 
only limited guidance as to whether such interventions should vá : s 
taken in the future or under what conditions they can be vi apr und 
successful, because few of these projects have been carefully eon agii 
In addition to the usual financial, administrative and political € Em 
to evaluation, we lack a well-developed methodology for evalua 
health education projects [5, 6, 7, 8]. "A 
In an earlier paper, this author reviewed fiftcen mass-media ne i 
and nutrition education projects in low-income countries for which rd 
quantitative measures of effectiveness were available [9]; this review 
five conclusions. x: 
The evaluations clearly confirm that mass-media health and MURS 
education projects can reach large numbers of people (up to e-É 
million) in a relatively short time. Although there is a conside a 
range in costs among the projects, the evaluations also show the e 
is possible to achieve this outreach at a cost as low as $0.01 P 
erson. S 
As fe as achievement of educational objectives is concerned, the mec 
ations suggest one positive conclusion: between 10 and 50 per rő 
of those reached by a mass-media health or nutrition education [se 
ject will remember the main message of the programme, at '€ 
during or immediately after the project. -—Á; 
There is some indication that people will adopt new health or diet r a 
behaviours due to mass-media health or nutrition education P 
jects; however, these reported effects must be interpreted pepe T t 
because most are self-reported behaviour changes, and many 
factors were simultaneously affecting the target audience. ledge 
There is no evidence concerning the long-term retention of know Hes 
gained from mass-media health and nutrition education pr uu on 
there is almost no evidence concerning the impact of such projec 
the short-term or long-term health status of the target aero, 
Although systematic information on this final conclusion is er 
unavailable, mass-media education h 


s Jt 
i projects in the hea for 
nutrition fields seem less likel " 


y to be successful as a substitute i 
ect provision of services than cement 
ch interventions or as a reinforc 


3 2 se 
? à Be of effectiveness measures »ossib e 
evaluate education projects in health and nutrition, it should be P 

to learn more from future evaluations. 
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Evaluation methodology 


Discussion in this paper is limited to just one component of evaluation, 
measurement of effectiveness, and to just one area of development 
communication, non-formal health and nutrition education using mass 
media. The reader interested in pursuing evaluation methodology further 
is referred to several reviews illustrating the wide range of possible 
approaches to evaluation [10, 11, 12, 13]. The particular problems that 
arise in evaluation of mass communications projects are well illustrated 
in three recent surveys of mass media projects [14, 15, 16] and are 
analysed in detail by Lumsdaine [17]. 

Figure 1 presents three categories of effectiveness measures for the 
evaluation of mass media health and nutrition education projects. Out- 
reach is the most easily measured effect of any mass media project. Out- 
reach measures may include the number of messages produced, the extent 
of media distribution and/or the actual number of people reached. 
Records at the project headquarters will usually suffice to establish both 
how many messages were produced and the extent of media distribution. 
In the case of print-based projects, the extent of media distribution might 


Number of messages produced 


Process measurement ——— — Extent of media distribution 
(outreach) Number of people contacted 


Attitude changes 


Product measurement Knowledge changes 
(educational objectives) — — Behaviour changes 


Morbidity 
Product measurement en Morality 
(health status objectives) Anthropometric 

Biochemical 


Fic. 1. Three categories of effectiveness measures for the evaluation of mass-media 
health and nutrition education projects. 
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be measured by the number of newspapers containing the message or the 
number of pamphlets or posters distributed. In the case of broadcast 
media projects, extent of media distribution might be measured by the 
number of stations broadcasting the message and the frequency and time 
of day of these broadcasts. 

An estimate of the number of people reached by a mass-media pro- 
ject can be made from the number of subscribers to the newspapers in 
which messages were printed, or the number of working radio or tele- 
vision receivers in the reception areas of the broadcasting stations. 
However, more accurate numbers can be obtained by conducting an 
awareness survey in which an appropriately chosen random sample of the 
target audience is interviewed to determine the percentage having seen 
or heard the message. 

The evaluations of many mass-media health or nutrition education 
projects have been limited to measurement of outreach. In some cases 
this was because the objective of the project was to distribute information, 
but more often it was because of the limited resources available for 
evaluation. 

Where the evaluation has included more than a measure of outreach, 
most non-formal education projects in health and nutrition have been 
evaluated in terms of educational objectives rather than in terms of health 
objectives. This is at least in part because the effects on educational 
objectives are expected to occur more quickly, and to be more directly 
attributable to the project. The three categories of educational objectives 
that are usually measured are changes in attitude, changes in knowledge 
and changes in behaviour. Of these three, changes in knowledge are the 
most frequently measured. Eleven of the fifteen evaluations of mass- 
media health and nutrition education projects from low-income countries 
reviewed in an earlier paper [9] included a measure of knowledge change. 
Questions to determine changes in attitude are often included along with 
questions to determine changes in knowledge. The answers to attitude 
questions may be less reliable than answers to knowledge questions due to 
a desire to please the interviewer, but often a change in attitude will be 
more important than a change in knowledge in promoting changes in 
behaviour. 

_ Changes in behaviour can be measured either by self-reported behav- 
iour, or by actual measurements of behaviour. Self-reported behaviour is 
more frequently measured because questions concerning behaviour can 
be included in the same interview in which questions about attitude and 
knowledge are asked. However, if the respondents know what the desired 
answer is and they wish to please the interviewer, questions concerning 
behaviour are subject to the same bias as questions concerning attitude. 

There are additional problems in assessing effectiveness using reported 
behaviour data. These can be illustrated by one technique that is omens 
used in nutrition research, the dietary recall. There are several variations 
of this technique, but usually an interviewer asks one member of the 
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houschold (most often the mother) to list the types and quantities of food 
consumed by the whole family, or one person in the family, during the 
previous twenty-four hours. Such dietary surveys can sometimes be useful 
in describing the general food consumption patterns of a community, but 
they are unreliable for establishing the adequacy of an individual diet 
both because there is considerable variation in daily nutrient intake for 
most individuals and because important sources of nutrients consumed 
between meals or away from home may go unreported [18]. Often 
nutrient intake calculated from dietary surveys has been found to be 
incongruent with nutritional status as measured by anthropometric or 
biochemical tests, and with established minimal requirements [1 9, 20]. 

In measuring the effectiveness of a non-formal health or nutrition 
education project, there are many possibilities for establishing actual 
changes in behaviour, depending on the particular objectives of the 
project. If the objective is to promote digging wells or building latrines 
to improve sanitary conditions, then the actual number of wells or 
latrines built during and after the project can be counted. Number of 


wells dug was one measure of effectiveness in the evaluation of the tele- 


vision programmes on ‘Water’, broadcast by the Out-of-School Edu- 
cation Project in the Ivory Coast [21]. The Tanzanian radio campaign, 
*Man is Health, was evaluated in terms of the number of latrines built, 
along with several other measures of effectiveness [22]. If the objective 
is to promote the use of other health services, then appropriate effective- 
ness measures may be the number of children vaccinated or the number 
of visits to a health clinic before and after the project. Another possibility 


for measuring actual changes in behaviour is to monitor the sales of 
particular foods; a radio nutrition education project 1n Ecuador s 
Shipments of iodized salt into the mountain regions as part o its 


evaluation 5 . , ; 

In the da: of this section, a more detailed discussion of the 
third category of effectiveness measures presented in Figure 1, measure- 
ment of changes in health status, will be provided. There de a e 
of techniques that might be adapted from evaluation of other public 
health interventions to evaluation of health or nutrition education inter- 


ventions. In general, the health status of a community assessed ae 
measuring one or more of the following: mortality = em en `; 
death rates); morbidity (sex and age specific rates for : erent pico! ; 
anthropometry (sex and age specific measurements O aon um ue 
height and weight are the most common measurement); "i nii 
tests (chemical analysis of organic specimens, most commonly blood, 
rA Seem Vn e measures, except mortality, to assess 


It is possible to use all of thes 
the este eats of individuals as well. Measurements of the above may 


be obtained either from special surveys done to evaluate a queis 
Project or from routinely collected data. The most common sources [9 
relevant, routinely collected data would be national vital statistics sys- 
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tems, hospital or health clinic records, and nutrition or disease surveil- 
lance systems. However, most often these routinely collected data arc 
aggregated at the national or regional level and, therefore, could only 
be utilized to evaluate a project that reached an entirc country or 
region. 

In a recent study by the World Health Organization [24], it is 
suggested that the three most useful indicators of the general health and 
nutrition of a population that can be derived from routinely collected 
data are: proportion of all deaths occurring under age 5; proportion of 
low-birth-weight new-borns; average height at school entrance. 

However, precisely because these are indicators of general health 
and nutrition status, they are influenced by many factors simultaneously, 


: education project is focused 
on one or more specific health problems, such as (a) boiling water to 


reduce diarrhoea among pre-school children, (b) improving the quality 
reducing deaths from neo-natal tetanus, it would 


2 objectives listed above would be (a) the rate 
of diarrhoea among 3-year-old children, (b) the weight for height of 
-natal mortality. 


. Surveys to establish the prevalence of a particular health problem 
1n à community, such as those listed above, 


health workers, interviewing a sample of th 
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few months of the project (assuming an adequate sample size for the 
evaluation). 

Before going on to look at some examples of health-sector develop- 
ment communications projects that have used health statistics as a 
measure of effectiveness, it is worth considering briefly what evidence 
there is that health or nutrition education should have an effect on health 
status. It is clear that the motivation underlying most non-formal edu- 
cation in health and nutrition is to do more than increase knowledge or 
to change attitudes; there is an assumption that the ultimate effect will 
be to contribute to an improvement in health [26]. 

Research concerning the effects of nutrition and/or health know- 
ledge on health status is limited, but available studies from low-income 
communities suggest that greater knowledge is not always correlated with 
better health. Wagstaff measured nutrition knowledge of different groups 
of South African blacks and found that mothers of children below the 
third percentile of weight scored similarly to mothers of better nourished 
children on a test of nutrition knowledge [27]. In Kinshasa, Zaire, no 
relationship was found between a mother's having taken a nutrition 
education course and the health status of her pre-school child [28]. A 
study in Lebanon found a positive correlation between nutrition know- 
ledge of mothers and the height for age of their children, but the mothers 
who scored better on the test of nutrition knowledge also had more years 
of schooling and a higher family income [29]. Another study of the 
effects of nutrition knowledge was done in connection with a nutrition 
education programme for pregnant women of Mexican descent in the 
United States [30]. This study found that improved nutrition knowledge 
was positively correlated with increased intake of protein and some vit- 
amins during pregnancy, but no relationship was found between nutrition 
knowledge and health status as measured by biochemical tests. The 
strongest evidence for the positive effect of nutrition knowledge on health 
Status is provided in an evaluation of several sources of nutrition and 
health education in Iloilo province in the Philippines. A study done by 
the Harvard Institute for International Development in collaboration 
with the University of the Philippines at Iloilo found that nutrition 
knowledge of mothers was significantly and positively related to the 
health status of their children, independent of the effects of other socio- 


economic factors [31]. 


Case-studies 


This section presents brief case-studies of three experimental development 
communications projects in which health statistics have been used in the 
evaluation as one measure of effectiveness; for none of the projects were 
the health statistics the only, or even the major, measure of effectiveness. 
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Two of the projects, a radio nutrition education campaign by 
Manoff International, Inc., in the Philippines, and the Stanford Three- 
community Study in California, were mass media-based non-formal 
health education projects. The Alaska telemedicine satellite demon- 
stration used mass media for health consultations at a distance. 


Manoff radio nutrition education in the Philippines 


Manoff International Inc., a United States-based advertising firm 
recently undertook two radio nutrition education projects, one in 
Nicaragua and one in the Philippines. The projects were funded by the 
United States Agency for International Development (USAID), and 
were designed to test the value of the reach-and-frequency technique, 
which has been successful in commercial advertising, for community 
nutrition education. Reach and frequency involves broadcasting short 
‘spots’ over radio or television in which the same simple message is 
presented repeatedly. The technique relies on the regular programming 
to attract its audience. 

In the Philippines, the Manoff nutrition education project was 
undertaken jointly with the National Media Production Center of the 
Philippines. Upon the recommendation of the Philippines National 
Nutrition Council, the target audience chosen comprised mothers of 
infants under 12 months, and the messages promoted both introduction 
of breast-milk supplements by 6 months of age and enrichment of 
weaning foods with oil, chopped fish and green vegetables. Six one- 
minute mini-dramas were produced in which a grandmother, having 
heard about the need for high-quality weaning foods for infants 6 months 
and older, explains this new feeding practice to her somewhat sceptical 
daughter. 

These six radio spots were broadcast in Iloilo province in the 
Philippines from October 1975 to October 1976. Radio time was 
donated through the National Media Production Center and the 
Philippines Broadcasters Association. The broadcasts were more frequent 
during the first months of the Project, and less frequent towards the end, 
but an average of three to four one-minute Spots were broadcast daily. 
Approximately 45,000 target mothers lived in the reception area of the 
co-operating radio stations, most on small rice paddy farms. For a more 
detailed description of both the community and the project, the interested 
reader is referred to the Manoff International Inc. final report [32]. 

The radio nutrition education campaign was evaluated both by 
Manoff International Inc., itself, as part of its contract to USAID and 
by the Harvard Institute for International Development in the United 
States in collaboration with the University of the Philippines College, 
Iloilo (the HIID/UP Iloilo evaluation) [91]. 

The Manoff evaluation was based on interviews to determine the 
impact of the messages on knowledge, attitude and methods of feeding 
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infants 6 to 12 months old. These interviews were conducted in approxi- 
mately 1,000 households (including some without radio receivers) before 
the broadcasts began, after six months and after one year. In brief, the 
Manoff evaluation found that after a year almost 75 per cent of the 
women interviewed could recall meaningful portions of the messages, 
the percentage who believed that adding oil to lugaw (the weaning food 
specified for enrichment in the messages) was good for infants increased 
from 15 per cent to 74 per cent, and the percentage who thought that 
adding oil to lugaw caused loose bowels decreased from 48 per cent to 
6 per cent. The Manoff evaluation also included measures of self-reported 
behaviour. Several different questions were asked concerning the amount 
and combination of ingredients added to enrich /ugaw, but in general the 
Manoff evaluation found a 10 to 25 per cent increase in the mothers who 
reported enriching their infant’s lugaw. One additional interesting finding 
was that most of the positive effects occurred during the first six months 
of the project; there was little change in response patterns during the 
second six-month period. 

The HIID/UP Iloilo evaluation attempted to go beyond the 
Manoff evaluation in several ways, in particular by measuring the 
weights of infants to determine if enrichment of lugaw was related to 
increases in weight. This evaluation was done at the same time as the last 
interview of the Manoff evaluation; 100 mothers of infants 6-15 months 
old were selected from among households that had heard the message 
but had not been interviewed as part of the Manoff evaluation. The 
particular message of the nutrition education programme selected for 
evaluation was the message advocating adding oil to lugaw because lack 
of calories was believed to be the most serious nutritional problem for 
children in the 6—15-month age group. The households included in the 
evaluation were selected to include fifty mothers who reported that they 
did not add oil to /ugaw, and fifty who reported that they added at least 
some oil once a week. In addition to weighing infants on a portable scale, 
the interviewer for the HIID/UP Iloilo evaluation asked mothers about 
the quantities of various foods they had fed their infant in the previous 
twenty-four hours, and questions to assess their nutrition knowledge. 
Various socio-economic characteristics were also recorded. 

The HIID/UP Iloilo study found no significant difference between 
the average weight for age of the infants who were fed oil-enriched lugaw 
at least once a week and those who were not (see Table 1). There are 
several possible reasons for this, and consideration of these reasons illus- 
trates the care that must be taken in interpreting health statistics as a 
measure of effectiveness in evaluating a project such as this one. 

The most probable reason for the finding of no significant difference 
is that insufficient calories were provided; an average of only half a 
teaspoon of coconut oil was added to each serving of lugaw (providing 
twenty to twenty-five calories) and lugaw was fed to most infants only a 
few times a week. Several other rice foods were also fed as supplements 
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Taste 1. Average weight for age! of infants given oil-enriched or not-oil-enriched 
lugaw for different age groups 
Ee 


Type of lugaw fed to infant 


Age in months N Oil-enriched? N Not-oil-enriched N 

&-9 50 87.3 22 92.9 28 
(12.3)? (14.9) 

— 28 86.1 10 87.9 18 
(16.8) (13-7) 

isis 22 80.2 9 76.2 13 
(10.2) (7-9) 


1. For each infant, their weight as a percentage of the median weight for that age group according 
to a Philippine standard was calculated, giving a weight for age. 
2. The lugaw fed to infants in this category was enriched with an average of one-half teaspoon of 


coconut oil per serving. In either group the /ugaw may have been enriched with other foods. 
3. Numbers in parentheses are one standard deviation. 


Source: This table is adapted from Table 18, p. 46, of the HIID/UP College, Iloilo, ‘Evaluation of 
the Manoff International Nutrition Education Radio Advertising Campaign in Iloilo, Philippines, 
October 1975-October 1976', by Marian F. Zeitlin and Candelaria Formación. Harvard Institute for 
International Development, Cambridge, Mass., 1978 (unpublished manuscript). 


to breast milk, but unfortunately the radio messages had only specified 
that lugaw be enriched, due to the incorrect assumption that lugaw 
was the predominant supplement fed to infants in this region of the 
Philippines. It is also possible that the infants whose mothers added oil 
to lugaw were those who were growing less well at the beginning of the 
radio project, and that the finding of no significant difference between 
the two groups of infants at the end of the project indicates a positive 
effect of the educational messages. Unfortunately, the HIID/UP Iloilo 
study does not include both pre- and post-project weights. A third 
possible explanation of the finding of no significant difference between 
the average weights of infants in the two groups relates to the basic 
assumption of the message. It is assumed that the low weight for age of 
infants 6 to 15 months old in Iloilo province is due to lack of calories and, 
therefore, that earlier introduction of supplementary foods and enrich- 
ment of those supplementary foods should improve growth. However, 
the cause of the poor growth could be due to diarrhoea caused, in part, 
by the introduction of supplementary food and, therefore, we could not 


expect to find the programme having a positive impact on the weight for 
age of the infants. 


Stanford Three-community Study 


From the autumn of 1972 through the autumn of 1974, researchers 
from Stanford University’s departments of medicine and communi- 
cations, with funding from the United States Public Health Service and 
the National Institutes of Health, designed and implemented a com- 
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munity health education project to reduce risk factors in cardio-vascular 
disease. The target population were adults aged 35 to 59 years living in 
Watsonville, Gilroy, and Tracy, three semi-rural towns in northern 
California, and the project has come to be known as the Stanford Three- 
community Study. Residents of both Watsonville and Gilroy were 
exposed to a bilingual (Spanish and English) mass-media non-formal 
health education campaign, which included the use of radio and tele- 
vision programmes, newspaper articles and advertisements, posters and 
direct mail messages. The third town, Tracy, provided a control com- 
munity. No attempt was made to design the experiment to compare the 
effectiveness of the different media used, but a comparison was made 
between subjects who were exposed to media alone, and a sub-sample of 
high-risk subjects in Watsonville who also received intensive face-to-face 
instruction. 

The overall objective of this health education project was to reduce 
cardio-vascular disease by changing life-styles that increase the risk of 
the disease. Specific messages provided instructions for those who were 
overweight to increase daily exercise and to adopt new dietary habits so 
as to reduce body weight through caloric restriction. Cigarette smokers 
were educated on the importance for stopping or reducing cigarette 
consumption, and instructions were given on how to do this. The nutrition 
messages were directed not only at reduction of total caloric intake, but 
also at decreasing total cholesterol consumption and increasing the ratio 
of unsaturated to saturated fats consumed. 

Because of its experimental nature, evaluation of the effectiveness of 
the educational messages was an integral part of the Stanford Three- 
community Study. Most of the evaluation results were based on three 
surveys; the first was done two months before the media campaign began, 
the second at the end of the first year of the project, and the third at the 
end of the second year [33]. Effectiveness of the nutrition education 
messages was based on three measures: changes in knowledge, self- 
reported changes in dietary habits and changes in plasma cholesterol 
level, which is one of the well-established risk factors associated with the 
development of cardio-vascular disease. The evaluation found a strong 
correlation between magnitude of educational input and magnitude of 
increase in knowledge of dietary risk factors. At the end of the first year 
of the project, the control community showed an average increase of 
only 8 per cent in knowledge (the sole intervention in that community 
was provision of a free physical examination each year). The community 
With exposure to mass-media education alone showed an average 35 per 
Cent increase in knowledge, and the community in which high-risk indi- 
Viduals received intensive face-to-face instruction showed an average 
Of 46 per cent increase in knowledge. The actual sub-group that received 
the face-to-face instruction showed a 74 per cent increase in knowledge. 

One component of the evaluation concerned the effects of : the 
Project on fat consumption [34]. This evaluation was based on a specially 
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developed ten-minute survey, which used forty-seven questions to charac- 
terize the average dietary behaviour of the respondent, and on blood 
specimens which were taken at each survey to determine cholesterol 
and triglyceride levels. As far as self-reported dietary behaviour was 
concerned, all communities showed a decrease in average milligrams of 
cholesterol consumed per day. However, the decrease was small in the 
control community and much larger in others. Most of the reported 
decrease in consumption of cholesterol and saturated fat occurred during 
the first year of the project, but there seemed to be some tendency for 
the participants exposed only to mass-media education to continue to 
report decreased consumption while the group with intensive instruction 
reported slightly increased average consumption of fat during the second 
year. Based on these measures of self-reported dietary behaviour, the 
educational intervention was judged to have been effective, and the use 
of mass media alone was judged to have been as effective as mass media 
plus face-to-face instruction. 

The health status statistic used to measure effectiveness in this mass- 
media health education project was serum cholesterol level. Not only 
was it possible to compare changes in serum cholesterol among the three 
communities (see Table 2), but the evaluators also compared the actual 


TABLE 2. Change in serum cholestorel levels 
between the first and second surveys by education group 


Nisa Observed Adjusted 
clinleststol change in change in 

Education group level cholesterol cholesterol 

ara level from level from 
(cuim MA surveys rto 2.— surveys 1 to 2? 
ido (mg.%) (mg. %) 

Face-to-face plus Men 226.3 (6.0)? —0.5 — 78 
mass-media Women 230.4. (6.4) —2.9 — 10.4 
instruction 
(Watsonville) 

Mass-media Men 214.4 (3.3) +o. — 6.3 
messages only Women 209.4 (3-4) +53 — 1.0 
(Watsonville) 

Mass-media Men 214.8 (3.0) — 0.4 — 6.8 
messages only Women . 210.3 (2.6) +0.4 = 59 
(Gilroy) 

Control group Men 210.7 (2.8) + 6.9 + 0.6 
(Tracy) Women 207.5 (2.8) +8.9 + 2.7 


1. Milligrams of cholesterol per 100 millilitres of blood. 

2. Because the method of taking blood samples at survey 1 was thought to have biased downwards 
the cholesterol levels observed at survey 1, an adjustment was made in those cholesterol levels and 
the change between the adjusted levels at survey 1 and the observed levels at survey 2 was 
calculated. 

3. Numbers in parentheses are one standard deviation. 


Source: This table is adapted from Table 3, p. 831, of M. P. Stern, J. W. Farquhar, N. Maccoby, and 
S. H. Russell, ‘Results of a Two-year Health Education Campaign on Dietary Behavior—The Stanford 
Three-community Study', Circulation, Vol. 54, No. 5, p. 826-33, 1976. 
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changes with the changes that would have been predicted by the reported 
changes in diet. In general, the evaluation found that during the first 
year of the project, average cholesterol levels dropped, or at least 
remained the same, in the groups exposed to the health education mess- 
ages, while the average cholesterol levels of the control group increased. 
However, the decreases in cholesterol levels predicted by the reported 
dictary changes were significantly larger than the observed decreases. 
Interpretation of these results is somewhat complicated by the fact that 
the blood samples were taken at the first survey under different conditions 
from those of the second survey, and the medical members of the evalu- 
ation team felt that the cholesterol levels obtained at the first survey were 
biased downwards; for this reason, both observed change in cholesterol 
level and adjusted change in cholesterol level were presented. Another 
difficulty with interpretation of changes in serum cholesterol level is that 
there is known to be considerable daily variation in these levels, and the 
small changes found in the evaluation of this project may not be bio- 
logically significant. None the less, the changes in serum cholesterol level 
are, for the most part, in the same direction as the changes in reported 
dietary intake, and thus they provide additional support for the claims 
of effectiveness based on the behavioural measures. 


Alaska Telemedicine Satellite Project 


Although it was a health service support project, rather than a non- 
formal health education project, a brief discussion of the Alaska Tele- 
medicine Satellite Project will serve both to illustrate another way in 
which communications technology can be used in the development of the 
health sector in low-income communities, and to provide another example 
of how health status measures can be used to measure effectiveness. A 
detailed discussion of both the project and its evaluation can be found in 
the final report of the evaluation, which was done by the Stanford Uni- 
versity Institute for Communications Research [35]. 

During 1974 and 1975, a biomedical demonstration was carried out 
in the Tanana Service Unit of the Alaska Area Native Health Service 
using the ATS-6 satellite; the project was sponsored by the US Depart- 
ment of Health, Education and Welfare. Both television and radio chan- 
nels were made available three hours a week during a nine-month period 
for consultation. Village health aides consulted with primary care phys- 
icians in Tanana, and those physicians in turn used the system to consult 
Specialists in Anchorage. One of the components of the evaluation of this 
Project was an attempt to determine the effects on the medical outcomes 
of patient treatment of this capacity for consultation with experts. The 
Tanana primary care physicians filled out a teleconsultation form for each 
video, audio, or telephone consultation indicating their judgement of the 
importance of the consultation to the medical outcome; at the end of the 
Project it was determined that about half the consultations had a prob- 
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able effect in preventing future patient disability, and that 2-3 per cent 
of the several hundred consultations were probably life-saving. These 
physician estimates of effect on medical outcome for each teleconsultation 
serve as a proxy for morbidity rates. Had the project continued longer 
and had periodic morbidity surveys been possible, it would have been 
appropriate to look at differences in morbidity, either among communities 
or over time, as a measure of effectiveness for such a project. 


Conclusions and recommendations 


Although only a small fraction of mass-media health and nutrition edu- 
cation projects have been evaluated, and not all of these evaluations have 
been based on reliably gathered data, the information currently available 
suggests strongly that mass-media campaigns can reach large numbers of 
people (including those who are illiterate and those who live in rural 
communities) and can, in a relatively short period of time, change the 
health knowledge and attitudes of a significant fraction of those who 
receive the messages. 

In the future, it would be more valuable for evaluations of projects 
in non-formal health or nutrition education to focus on the question of 
whether such projects (including those using mass media) can make a 
significant contribution to changing health related behaviours and health 
status. For the most part, the answers to these questions will come from 
reasonably large-scale projects, because usually changes in health status 
can be expected only from long-term health or nutrition education proj- 
ects, and ones which reach a large number of people. 

Health statistics can also be most appropriately used to evaluate the 
effectiveness of a health or nutrition education project when this aspect 
of the evaluation has been anticipated during the project design. To the 
extent that the objectives of the project can be stated in terms of specific 
and anticipated changes in behaviour and health status, suchas increasing 
the home use of oral rehydration during diarrhoea and decreasing 1- to 
4-ycar-old mortality from diarrhoea, or increasing the use of mixed cereal 
weaning foods and decreasing the percentage of 2-year-olds with low 
weight for height, both the effectiveness of the education project and 
the quality of the evaluation are likely to be improved. The evaluations 
of the Manoff radio nutrition education project and the Stanford Threc- 
community Study suggest that, for the most part, large behaviour changes 
will be necessary before significant changes in health status can be 
expected. 

The main reasons for using health statistics to evaluate certain 
development communications projects, such as mass-media health and 
nutrition education projects, are the following: 

The outcomes being measured are of great interest to those in the health 
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sector; most health researchers, government planners and funding 
institutions accept the social importance of significant changes in 
mortality, morbidity, anthropometric measures or biochemical tests. 

Even if significant changes in health status are not found, the direction 
of change in measures of health status can assist in interpreting 
changes in educational outcomes. 

The use of health statistics as a measure of effectiveness will make it 
possible, in some cases, to compare the cost-effectiveness of health 
or nutrition education interventions with other public health inter- 
ventions. 

However, there are also important disadvantages to the use of health 

statistics as a measure of effectiveness in evaluating non-formal health or 

nutrition education projects; in particular, the following should be kept 
in mind: 

Other socio-economic and disease variables will affect health status along 
with any effects of the education project, so the evaluation design 
must take these into consideration through appropriate control sites 
or variables. 

Some health statistics can be obtained only by using specialized tech- 
niques, and the costs of buying the equipment and training field 
workers may increase considerably the expense of the evaluation. 

While the significance of changes in health status is more widely accepted 
than the significance of changes in health knowledge or attitudes, it 
is quite possible that changes in health outcomes will be measured 
that have statistical significance but questionable biological or social 
significance. 

In summary, then, we can conclude that a decision to include health 
Statistics as a measure of effectiveness in the evaluation of mass-media 
health or nutrition education projects must be considered carefully. The 
Choice of which effectiveness outcomes are appropriate to measure will 
depend on (a) the objectives of the project, (b) the resources available for 
evaluation, and (c) the decisions that will be based on the evaluation. 
Often it will be inadvisable to attempt to measure changes in health status 
because the education project was designed to reach only a small number 
of people, or was a short-term campaign. In addition, the specialized 
methodology may make health status measurcs costly to obtain and even 
once obtained, they may be difficult to interpret due to the influence of 
other variables in addition to the education intervention. On the other 
hand, since the ultimate objective of a non-formal health or nutrition 
education project is to improve health status, it would be valuable to 
know whenever possible if such an improvement had occurred. 
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Case-studies 


Cost analysis of primary education 
by television in the Ivory Coast 


J.-C. Eicher and F. Orivel 


Introduction 


In 1971, the Ivory Coast embarked on a reform of primary education, the 
principal feature of which was the introduction of television into the class- 
room. The reform also included the provision of relevant printed matter 
and the reorganization of teacher training. M 

The reform had several objectives, but its two main aims—which 
were complementary—were to make it possible to achieve 100 per cent 
enrolment in primary education and to provide an education appropriate 
to the characteristics and needs of society in the Ivory Coast. In theory, 
the methods employed were to make it possible to reach these objectives 
at a lower cost than by relying on the traditional approach. Among other 
things, it was thought that *television teachers’ would be trained more 
quickly than ordinary teachers and could be paid at a lower rate. 

Several research workers have already examined the costs of this 
experiment. Chau? tried to estimate ex ante—or forecast—costs; Jamison 
and Klees? had some observed data available but their study is mainly 


1. This case-study was written in the early stages of the preparation of this volume. 
Th lightly outdated it remains relevant. — 5r 

2. Ta Ni. Cán, Tory Coast: The Cost of Introducing a Reform in Primary Edu- 
cation’, Educational Cost Analysis in Action: Case Studies for Planners, Vol. 2, p. 11-61, 
Pari IIEP, 1972. : é i 

3. DUE enit end S. Klecs, The Cost of Instructional Radio and Television for Developing 
Countries Washington, D.C., Educational Resources Information Center/Stanford, 

> g 


Calif., Institute for Communication Research, Stanford University, 1973. 
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based on forecasts. On 19 March 1976, the Ministry of Education’s 
Service Autonome des Etudes Générales de Planification et des Etudes 
Statistiques, together with the Directorate of Development Studies of 
the Ministry of Planning, published a fairly detailed document on unit 
costs in 1975, but it did not deal with the past or the future. Unfortunately, 
it is difficult to compare these studies with each other and even more 
difficult to compare them with cost studies carried out elsewhere. 

We shall therefore try to give a complete picture, set out as clearly 
as possible, so that every administrator, planner, economist and policy- 
maker will be able to find the information he or she needs. At the same 
time, we shall try to provide for comparison with the findings of the 
Klees-Jamison study. 

We shall begin with a detailed account of the system’s structure and 
the costs entailed, emphasizing the assumptions made concerning its 
development. We shall then proceed to a more thorough analysis of econ- 


omic and financial problems by examining the costs by contributor and 
the unit costs. 


Part 1. Development of primary education 
in the Ivory Coast, 1971-90 


In order to situate the problem, we start by recalling the general organ- 
ization of the Ivory Coast’s primary education system and by analysing 
the development of pupil flows within that system. We shall then look 
into costs. To avoid all ambiguity over the concepts being used, we 
shall first classify the costs and then proceed to a detailed study of the 
various elements of this classification. The second section will deal with 
their breakdown in accordance with other criteria and will provide an 
interpretation of observed or presumed developments. 


Organization and development prospects 
of primary education by television 


The Ivory Coast’s new school system was introduced in September 1971 for 
pupils beginning their first year of primary education (i.e. CP 1), fol- 
lowing a period of meticulous preparation between 1968 and 1971 by 
Ivory Coast primary-education officials in collaboration with France and 
the relevant international organizations. 

These pupils then passed through the various primary classes, CP 2 
in 1972, CE 1 in 1973, CE 2 in 1974, and CM 1 in 1975. When the 1976 
school year opened, they began their final year of primary education 
(CM. 2) and, at the end of the 1976/77 school year, the first cohort of 
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children taught entirely by means of television from the CP 1 level will be 
leaving primary education. 

As well as these television pupils there are two other categories of 
schoolchildren, those in traditional public education and those in private 
schools. It is intended that the television scheme will gradually take in the 
majority of pupils from the traditional public sector as the television net- 
work is extended to cover the whole of the Ivory Coast. Only a very few 
sparsely populated zones where the cost of coverage is prohibitive will be 
unaffected. 


General organization 


Production. The production department is located in a former school 
at Bouaké. The buildings house the teams responsible for the subject- 
matter of both the television programmes and the printed materials to 
accompany them, the production teams and the training unit for the 
television schoolteachers. These divisions come under a general adminis- 
trative department and share various supporting services such as trans- 
port and garage, maintenance, store and a multi-media library. The 
division concerned with printing the documentary materials is located 
in separate premises. 

All these departments are occupying temporary accommodation on 
a provisional basis. The Klees-Jamison report suggested that the premises 
could have been retained permanently, thereby saving a great deal of 
money, but for various reasons the opposite solution prevailed and new 
buildings are now being put up in Bouaké. f 

These buildings, financed by a World Bank loan, will house all the 
departments from the old site as from 1977. It is still not clear what will 
happen to the present buildings but there is talk of their being shared 
by the Ivory Coast Radio and Television (RTI) „and the department 
which handles training for the school television project. This uncertainty 
complicates the task of estimating net future costs. — 

Hitherto, the production services were managed in such a way that 
the various functions could not be costed with accuracy, thus obliging us 
to make many assumptions. In the past year, however, DOGE! has been 
making a great effort to rationalize matters, and future attempts at cal- 
culating costs will be less troublesome and more reliable. 


Reception. Without going into detail, the programmes are broadcast by the 
RTI network. They are sent from the Bouaké centre to Abidjan and then 


retransmitted to the country as a whole. y 
Each school class has a television set of a single standard model 


Specially designed for a tropical climate. It uses little electricity (less than 


1. Division d'Organisation de la Gestion de Éducation (Division for the Organ- 
ization of Educational Management). 
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4o watts) and can be serviced by semi-skilled staff thanks to a system of 
replaceable modules. ; . 

The previous report by Klees and Jamison discussed whether a tele- 
vision set should be provided for each class (A) or for two classes (B). Bis 
less costly but calls for a great deal of movement between classrooms since 
the programmes last about ten minutes and are then used for about an 
hour as the basis for work before the next broadcast. The B system would 
therefore only work if the pupils of each class were taken every hour to 
the classroom with the receiver. 

It was thus decided to use (A) for the first five years of school tele- 
vision, and though more costly it made things easier for the pupils. 

The architectural department of the Ministry of Education is at 
present examining a method of fixing the set on a pivoting base so that 
it can serve two adjacent classrooms without the pupils having to move. 
The technical obstacles to this idea have not yet all been overcome but 
itis a reasonable assumption that this system will, at some future date, 
reduce costs considerably and we shall endeavour to take it into account. 

The main reception problem concerns the electricity supply. As the 
Ivory Coast grid only reaches some 15-20 per cent of the sets now in use, 
an independent power source has had to be found. Plans to extend the 
grid will probably not improve this situation by 1990 since the expansion 
of the television school system is mainly occurring in the non-electrified 
zones. 

The result is that 80-85 per cent of the television sets are run off 
alkaline batteries, which have so far proved cheaper than any other form 
of independent energy, such as electric generators, solar cells, wind-power 
and so forth. Foreseeable advances in solar energy technology, however, 
make it possible to envisage the gradual supplanting of the very costly 
alkaline batteries by solar cells, but progress is slow and no significant 
savings can be expected before the beginning ofthe 1980s. 

In the short term it is planned to manufacture the batteries locally 
instead of importing them. This is unlikely to reduce unit costs very much 
but it would save foreign currency. 

The Compagnie Africaine de Télévision (CATEL), a private 
company based in Abidjan, has been entrusted with installing and ser- 
vicing the receivers, masts and aerials. It has organized mobile teams 
which visit the schools once a month, each team following a pre-arranged 
circuit. If a breakdown occurs between visits, breakdown teams with 
radio-equipped vehicles can be called out and quickly reach the place 
concerned. 

This system scems quite reliable. As breakdowns average only one 
per set every two years, those in charge of the system are thinking of 
extending the planned average life of the scts to seven or even ten years. 
In addition, a new model is at present being planned that would require 
almost no servicing and whose breakdowns could be put right by the 
teachers themselves. 
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Primary-education enrolments 


In 1975, a little over half the Ivory Coast children in the 7—12-year age 
group were at school. 

The growing provision of schooling may be gauged from the planned 
expansion of the access rate to the CP 1 level, shown in Table 1. 

The expansion should lead to almost total enrolment in 1990, when 
the 1984/85 CP 1 entrants will be completing their primary education. 
After allowing for drop-outs, the enrolment rate for the 7—12-year age 
group is planned to average 95-96 per cent at that date. The proportion 
of television school pupils will rise from 54 per cent in 1976/77 to about 
90 per cent in 1990 (public sector), the cost of providing television cover 
for the remaining 10 per cent being still too high. 

One of the most radical innovations accompanying the reform of 
primary education has been the concern to put an end to the catastrophic 
repetition and drop-out rates which were a feature of the traditional 
system. In the television secteur today the average repetition rate is under 
10 per cent, as against 28 per cent formerly. It is expected to drop still 
further, to 7 per cent in CP 1 and to 5 per cent in CP 2, CE 1, CE 2 


and CM r. 
The drop-out rate at the end of each year of studies has also fallen a 


lot, and present targets provide for a maximum of 1 per cent. 


Recent pupil flows in television schools. Yn Table 1, the pupils in a given class 
comprise three categories: those arriving from the preceding television 
class; repeaters; and those coming from a non-television class. 


Taste 1. Pupil numbers in television classes from the start 
of the system to 1975/76 


"— Áo DOE pd 


Year CP: CP 2 CE : CE 2 [oven Total 
1971/72 22,000 aigo 
1972/73 38,000 20,000 ‘ ees 
197 0,6: 04 19,231 ; 
i pus e 18,628 160,971 


1974/75 57,239 49,094 36,010 


1975/76 745569 56,819 47,984 34:355 17,484 231,211 


Although it does not happen here, it is theoretically possible to have 
more pupils in the next higher class if the entrants from outside sources 
more than make up for net losses from repeaters and drop-outs. 


Forecast enrolments, 1976—90- The National Plan includes projections of 
enrolments up to 1990, known as Projedor (computer-based projections 
for education). Several assumptions, numbered 1 to 10, have been tried 
out. They vary according to the estimates made concerning the maximum 
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size of classes and drop-out rates, particularly at the CM 2 level. In actual 
fact, automatic promotion will bring into CM 2 large numbers of children 
aged 11-12 years who are ill-suited to secondary education and who 


cation. A ‘waiting-room’ of this kind is clearly u 
logically and economically, and alternative arra. 
made for them. 

It is a difficult business to choose betwee 
their assumptions are all equally 


probable costs worked out in each case. 
» the differences between their figures for future 
smaller than the margin of error in our 


5 and ro, for example, which arc generally 


more than 20,000 out of 1.5 million 
satisfied to achieve cost estimates with this margin 


TABLE 2. Forecast television school enrolments by class 
and by year up to 1990 


Year CP: CP2 CE 1 CE 2 CM 1 CM 2 Total 


1976/77 96,586 73,508 — 55 304 46,95: 33 k 
? 9346 21,550 27,2. 

1977/78 — 113,066 96,381 72,239 54370 — 46,17 46,196 pr ie 
1978/79 129,618 112,901 53,954 — 66,218 431,328 
EOM 120404. 125716 110,892 94954 — 70770 77628 ^ 619364 
toBijBa eee 139449 122,756 109,047 957714 — 98,505 712,309 
1982/83 iyeiaga 147501 133,7 120,964 108,362 124465 800,173 
1983/82 T en 159,738 145,313 131,922 120,331 139,912 875,846 
1984/84 Ro 172,877 157,418 143,160 — 130,661 148,550 951,117 
1985/08 — 2a e 191,217 170,374 — 155,130 142,409 155,680 1,025,050 
1998/8 E a 3 202,980 188,261 167,907 154,366 165,132 r,106 342 
pene 229182. 219,629 200,014 185,360 167,093 176,586 1,187,064. 
Hio aano) ap zu, omaso lia iple | 1107 Ob 
1989/90 273,393 2592.7 239,272 224163 nv arene! 1845108 
1990/91 — 285,144 264,183 379. 2175431 — 1,415,894 


221,991 290,26 
Source: Projedor 9. 223 30,369 I 


487,074 


arbitrarily chosen Projed. 


tion that we regard as 


desirable, nam, l ts an assump: 
in CM 2. mae... 


a large number of drop-outs 


These projections assume that, once the new DIGO transmitt 
ers are 
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in service, at the start of the 1976 school year, those covering the south- 
west in 1977 and the centre-west in 1978, 88 per cent of CP 1 pupils in 
public education will go into a television class for the 1978/79 school year. 

As we have seen, 10 per cent of pupils will not be covered by the 
television system. It is thus fair to say that, by 1978, the school television 
programme will have reached its ‘cruising speed’ as far as CP 1 is 
concerned. Further increases in enrolments will be due to population 
increases (larger age groups) or to higher enrolment rates. 

The proportion of private schooling is expected to fall considerably, 
as Table 3 shows. 


TABLE 3. Forecast enrolments in State television schools, 
State non-television schools and private schools respectively 


non- State 3 
siio television Tiyato Total 

1975/76 enrolments 316,172 231,211 125,590 672,973 
percentage 47-0 34-4 18.6 100.0 

1980/81 enrolments 133,830 714,032 125,167 974,629 
percentage 13.8 73-4 12.8 100.0 

1982/83 enrolments 119,475 888,118 116,562 1,124,155 
percentage 10.6 79-0 10.4 100.0 


nfirm the capital importance of primary 
which will rise from one-third to nearly 
nrolments, this means that the 
e. Private education will still 


The next four years will co 
television schools, the number of 
three-quarters of the total. In terms of e 
number of pupils in such schools will tripl 
Provide for a little over 100,000 children, which is just under 20 per cent 
of the total today but will be only about 10 per cent in six years’ time. 


During the period covered by the next national plan, therefore, 
School television is going to go through a decisive stage and one that will 
ial reductions in cost that 


be difficult because it will precede the substanti: 
we think can be achieved from 1980 onwards. 


New television classes. New classes depend on the number of pupils to be 
Provided for (sce Table 2) and on the accepted teacher/pupil ratio; that 
is, the number of children per class. This has to be worked out for each 
Year of study since the children of a CE 1 class, for instance, cannot be 
transported from one school to another in order to make up for drop-outs 
at the end of GP 2. Only two classes leave some room for manoeuvre: 
1, which determines the number of children in subsequent classes and 

Or which a gradual reduction in the number of children per class is 
contemplated (Projedor 9 has 46.5 pupils in 1976/77 and 42.6 in 1 990/91), 
and CM 2, which runs the previously mentioned danger of having pupils 
| they have failed the entrance 


for several years in succession because : he e 
€Xamination to secondary education. To avoid overcrowding in these 


The economics of new educational media: cost and effectiveness 
II2 


classes, Projedor g assumes the maximum 
falling to 43.4 in 199o. 

In brief, the average class size according to Projedor 9 should fall 
from 43.72 in 1976/77 to 41.48 in 1990/91. 

When the effect of Projedor 9's assumptions on the number of tele- 
vision classes is compared with that of Projedor 93's, it can be seen that 
Projedor g provides for more classes initially, then fewer class over a 
period of seven years, and once again more classes until 1990; but the 
final overall difference is only 413 classes, or 1.13 per cent (Table 4). 


size to be 50 in 1977, gradually 


TABLE 4. Total numbers of television classes 


A—— ALL 


Difference 
Year CP: GPs CE: Gg. cM; CM 2 Total New — as compared 
classes with 


Projedor 3 


pe, 
1972/73 — 937 45; — d 95 i 
1973/74 1,129 — 937 2,523 1,129 // 
1974/75 1,324 1,129 953 457 3:847 1,324 || 
"in 1608 1,245 5,182 1,335 ll 

77 207] 1717 1,85 1,196 
1977/78 2,469 2,148 r qe m E is daga t P" 


| 


1,730 1 
1978/79 2,880 2579 gog 179? DIJI gə5 9765 
1979/80 3,134 2,882 27566 


2 js 12,106 2,341. — 157 
:222 1,790 1 14222 2116 — 

se 3:430 3,134 2,874 2,565 2,218 2,145 16966 2,144 m 

a 3730 3436 3,132 9.864 2259 2:64 18485 2119 — 26 

9 3 4,055 3,730 3:434 3:123 2,85: 3,110 i 

1983/84 4,510 4,059 i 


20,303 1,818 — 271 
1984/85 4800 2059 B732 3433 3114 $30 22,164 1,861 odo 
3:491 24,0 
eee BT 1910 45504 4,06 371: cue 24,002 i Eos 
» 3230 » 
1987/88 3:995 28,072 ,038 
[oUm 5811 5505 5:229 4,828 4,472 4295 90 Hi mie HE 
1989/90 Gado Died 98d B242 4797 4646 oe’ 3 2 
if 5 5,93! 5; 
1990/91 6,694 6413 Brag 3,850 54 Sand 8 
Source: Projedor 9. d 35851 1,8 


j -quality 
n recent years, then e pro : 

457 classes in its first year to bite nds E lhe tenfold, from 

again in the next five years, t d 


900 in 1975/76. Tt will triple 
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the period in question, a figure which has not yet been achieved for any 
of the new school years since the programme started. 

This means that, in absolute terms, there will be no respite during 
the entire period; indeed, the overall stock of facilities needing to be 
maintained or replaced will be increasing all the time. 


Reception costs 


From this section onwards, our analysis of the costs of the major functions 
is based on data gathered locally from the various departments concerned, 
whom we would like to thank for their courtesy and diligent co-operation. 
Special mention should be made of the document, dated 19 March 1976, 
produced jointly by the General Planning Department of the Ministry 
of Education and the Ministry of Planning, which provides a detailed 
analysis of costs in 1975. 

We shall examine in succession: the cost of television sets and related 
items; the cost of the power supply; and the cost of maintenance. 


Television sets and related items 

Television sets are purchased to cover the necds of classes but also for 
teacher training, the central administration, and the Bouaké production 
centre. A certain number are stolen, estimated by the Klees-Jamison 
report at 1 per cent per year. In fact, the number of sets lost has been as 


shown in Table 5. 


TABLE 5. Number of television sets lost 


1971 1972 1973 1974 _1975 
Stock 1,332 2,432 4:348 5,848 6,848 
Missing i 26 17 20 17 
Percentage missing = L.X 0.4 0.35 0.25 
meee ee noo ce m oid 


As the number missing has dropped from 1 per cent when the 
Project began to 0.25 per cent today, it docs not seem to us very important 
to take it into account when forecasting since it will, without any doubt, 
have less impact than uncertainty about the real cost of television sets 
Over the next fifteen years. / 

The estimated requirements for aerials over the same jen ess 
Period are 10,050, or 1 per 1.6 classes. It should be possible to reduce 

is to 1 aerial for 2 classes. Here, too, price increases have been excessive, 


thi Y 
more than tripling from 4,500 francs in 1971 to 15,250 in 1976. The cost 


has been estimated at 13,000 1975 C.F.A. francs cach. 
The tool ten-year cost per class comes to 37,000 C.F.A. francs for 


Masts and 6,500 C.F.A. francs for aerials, or 43,500 C.F.A. francs 
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altogether; the cost per class per year is therefore o GF. 
figure that was then aA » the number of $m rimini 
The total cost of purchasing and installing television sets, about 
200 million C.F.A. francs in 1974 and 1975, will quickly reach 400 million 
francs in 1977 and 800 million francs towards 1985, remaining steady at 
this level until 1990. The figures assume one set per class which, it will 
be recalled, was the more expensive alternative for reception costs. 
Part 2 will examine the probable savings from assuming 1 set for 2 classes. 


Power supply 

a key factor in the cost of school television is the electricity supply for 
the television sets. Though 15-20 per cent of them are connected to the 
mains, 80-85 per cent must at present be run off alkaline batteries. 


Problems of method. We shall mention two only: 


1. Problems of accounting for use. When a school television set is powered 
by alkaline batteries—that is, in eight cases out of ten—the unit of 
thirty-two batteries is known to have an average life of 2,000 hours, 
equivalent to two years of operation at 1,000 hours per year. But 
other sources show that the time actually spent on school broadcasts is 
far less and that there exist three other explanations for the set being 
switched on: for non-formal educational programmes; ‘pirate’ tuning 
in to commercial programmes; leaving the set on without the sound 
between two consecutive school programmes. 


Taking cach case in turn, non-formal programmes do not in 


fact exceed thirty hours a year but the amount of listening to 


commercial programmes is difficult to estimate; it is, in theory, 
forbidden but ways are found of getting round the rules. However, 
it would be very rare for the set in each classroom of a school to be 
switched on for as much as one hour each evening throughout the 
year. It is more realistic to halve this figure and thus assume an 
average of 180 hours ‘pirate viewing’ per year. This represents, in 
round figures and including non-formal educational programmes, 


200 hours of non-school operation per year. Our conclusion is thus 
that the television sets are used most by being kept on between two 


consecutive school programmes, à very widespread practice that 
many observers have noticed. 


This argument suggests th: 
television accounts for 800 and other uses 200. 

2. Changing from alkaline batteries to solar cells. A few television sets are 
now using solar cells made in the United States. These cells were not 


designed for this purpose, with the result that they do not last long, 


and their unit cost is still very high. E ; 
According to information at OUT disposal, the technical and 


economic aspects of the solar cell may be summed up as follows: 


at, out of 1,000 hours per year, school 
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ili corrode than cadmium sulphide ones 
i p si fal rs E suitable; changes in the price per 
ive rin are estimated as follows: 1975: $21 (source: Henri 
Darand Congress on solar electricity, Toulouse, 1975); 1975: $5 
(source: ERDA-ISES Congress abstracts, 1975); 1980: $4 win 
Gentre d'Études Nucléaires, Grenoble, France); 1985: $0.5 (source: 
ERDA); 2000: $0.1 (source: TEJE—Grenoble, France). i 
This price concerns peak power; that is, in the best possi ; e 
conditions of sunlight. It is estimated that, in ‘temperate zones’, the 
peak capacity must be multiplied by seven to obt 


s that a 40-watt 
220 watts. 


Estimating the cost. The cost in U.S.$ 
solar-cell unit to power a television set 
$1,100; 1980, $880; 1985, $110; and 2000, $22. 


If these figures are plotted in order to obtain 
of the Programme, the result is as 


per watt x 220 (see above) of a 
for the year 1975: $4,620; 1978, 


the cost in each year 
shown in Table 3 


TABLE 7 
Year US$ C.F.A. francs Year U.S.$ C.F.A. francs 
1979 1,000 250,000 1985 110 27,500 
1980 800 200,000 1986 95 23,750 
1981 620 155,000 1987 Bo 20,000 
1982 480 120,000 1988 70 17,500 
1983 340 85,000 1989 60 15,000 
1984 220 55,000 1990 50 12,500 


This should be set against the cost of the 
batteries, 307,200 G.F.A. fr i 
expected to remain Steady i 


of American and F; rench res 


onger b 
Onsequences: (a) 
efficient for the Ivory Coast to j 


ee ES 


"A[snorA21d s1eaÁ uo) pəjpe;sur $19urejuo2 Áiajjeq jo 3uouroov|do1 ‘spremuo 1961 wor *L 


9p JIEN 10} 81809 juouroov[do1 


*(sureur ot uo jou sjos uoi 1A9[9) JO uonod. 
q snid (bbig) sossv[o uorstAo[o) Mou jo yoquinu əy} Aq (ooo*ooz; 


"uonsanb ur aeoÁ əy} Surmp poseuo1nd oq 0} sim [22 1e[os jo Joquinu oi 3u2s21do1 so1n8y osou p, 
"sosse[o Mou pre Surddmbo jo ysoo ay} pue A[ddns 1240d Arayjeq * yım sossv[o Sunsa 

ILVO 'og-9461 wory ‘(suey "y'o SL61 ur) soseyoand [enioe ‘SL61 03 1461 wor 
"vof Jey} ur pojpeisur si[o2 1e[os Jo Jd x og'o x Sossv[D MON ‘H 

"og'o X sosse[? Mou sn[d poddmbo 394 jou sosse]o Sunsixo x (000 
load 10} 3uor1g202) og 


'spivMuo 1961 wor "(soorid $461 3v) syseoo103 3590 q pue T 


"o Aq pordnjnux-o1 Suroq uo 1onpoad əy} *(111*2) yno Buruuns 
) og61 ut s[oo av[os Jo aorid yrun oq SurA[dnpnur Aq paureiqo ‘z 


i 


*GG1) 3505 yrun 1961 


*SL-£461 ut uSrq ab ərəm syo0}s Áxojjvq—syoo1s umop Suruumw ^1 


"noggnomq sonəyeq oues Surumsse :zH 
“S[[99 1e]0s Áq poov[dox ore sənəyeq suere yey} 3urumsse :rpp 


$9.'€ 609'€ otg Ltz& Los LLg'v  ooL's  6o&'z  z6z'z gzis  16L 66S oS9 zog Siz o6z 195 Tos Egri zl suyeq Fe 
M e: uonvonpo 
ot gt ob Gh öli gf $9 zor obi 916 gı‘ 666 oSg zoë Siz o6z 197 bez SE1 zl S[[22 REY 
Avjos UH o 3507) 
Gul 11G ggat 6Soh zbg'&  96€'6 GLEE ggrg Sgg’z  ogofv 696 gbl vig LLE 695 $98 gzt ogz 991 06 souoneq 
oumexre SH H 
LE Gh gg 191 Giz Sp 1g Lai SL1 Shit ogb ghL vig LLE 695 $98 gzE ogz 991 06 s[[2 ToL 
Ave[os HH 
16 1G £S 6v oS ob rb ob LE 128 6z ef t? hw 6 gr kt 95 oz gr satioyyeq 
sutpexre :zg | sroureyuoo 
— — — 98 A db 6s. gr t: gs oz gI spo» Áxoyeg 
Ae[os "IH 
loth ogb Sze orot z6L'€ OSS PESEE  96o'€  gzg'z B29 096 or4 ggL 966€ obs SHE Gof zSz gbi cL — souoneq 
T4 C « 6 « " 9utpexre zH 
T£6'z Loog hots g£o'6 T&£o'G 9z9'1 okb 6g +S pge tob‘ suyeg 
£ Sy £c igi Si „St +18 ma S41 Shir gogh“ ort g9L 966 jobs SHE Gof zS5 ghi uL sI? 
Jv]os : IH 
0661 6g61 : 9861 ‘Lg6t 9961 m E $961 $961  zg6r 1861 og61 6L61 gL61 L261 g461 GL6: L61 EL61 zL61: 1261 


a ee REIR 


(soueg yO jo suotu ur) A[ddns zamod Tv2ro9[o JO 4500 *9 a 18v], 


The economics of new educational media: cost and effectiveness 


118 


nation of solar cells and auxiliary accumulators for all regions of the 
Ivory Coast since the relative cost of a battery unit is such that it would 
soon be worthwhile to over-equip installations with solar cells in order to 
obtain 40 watts in the least favourable conditions of sunlight. A small 


the 1975 
ost throughout the period. 


lls is estimated at six years. 
ize is that alkaline batteries cost 
by the end of the next decade) 


ure cost of solar cells, it is clear 
that alkaline batteries must be abandoned in the very near future, by 1980 
at the latest. 
Maintenance 
Each year CATEL 


presents a general bill for servicing the television equip- 


ment. This includ rol and the company’s 


fees, but does not ¢ 
themselves, 


to convert the amount 


© 1975 francs; for 1976-80 h cepted 
CATEL’s estimates, and for 1981 “4 a ii 


| -90 our figures are based on a pro- 
portion of 1971-80 costs and the 
uipment and vehicl 


TABLE 9. Total mainte; 


2 nance costs 1971 
(in millions RE 


of 1975 G.F.A, francs) 


1971 1972 1973 1974 — 1975 1976 1977 1978 1979 
Test equipment 
and vehicles 12.6 E 
Installation and P9 WS isd gë aga 49.6 36.3 390 
maintenance 157-0 308.0 316.0 361.0 362.0 448.0 495.0 544.0 598.0 
TOTAL i ; : 
169.6 328.3 339-9 3845 393.8 474-0 535.6 580.4 637.0 


COsls 1971 


(in millions of 1975 G.F.A, XM 
Year By class By school Year By class By school 
1971 0.371 0.371 
1972 0.235 0.350 min Eos Me 
1973 0.132 0.296 1978 "es Des 
1974 0.100 0.290 1979 pee a 0188 
1975 0.076 0.244 


0.0444 0.188 
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Where maintenance is concerned, lower unit costs should be expected 
because, for onc thing, the marginal cost will fall and, for another, tele- 
vision sets needing minimal servicing will be introduced. It is quite pos- 
sible, however, that labour costs will increase since the wages of CATEL 
workers are unlikely to remain at their present level over a long period. 

On the whole, our view is that all these assumptions probably cause 
maintenance costs to be exaggerated. 

The decreasing average and hence marginal cost, particularly by 
class, emerges clearly, since a visit to service a single classroom costs almost 
as much as one to inspect several classrooms in the same school. Figure 1 
shows how this series of figures can be plotted to obtain the following 
forecasts for unit costs per school. 


"TABLE 11. Forecast maintenance costs 
race MCA er AD EUNT ai ree SE) 09) 
Unit cost per "Total costs Unit cost per Total costs 
Year school in millions Year school in millions 


in C.F.A. francs of C.F.A. francs in C.F.A. francs of C.F.A. francs 


1980 180,000 658 1986 150,000 832 
1981 175,000 705 1987 150,000 872 
1982 170,000 733 1988 150,000 914 
1983 165,000 759 1989 150,000 958 
1984 160,000 792 1990 150,000 1,041 
1985 155,000 816 


Actual costs will probably be lower if a still more reliable model of 
television set is brought into service. This, however, is still no more than a 
Possibility and it is difficult to know whether the future model will be 
more costly than the present one. The cost of television sets is, however, 
regarded as a constant. Thus in the event of a changeover, buying costs 
would probably rise while maintenance costs would fall. ' 

Table r2 summarizes overall reception costs on the assumption that 
Solar cells will replace alkaline batteries. ; 

It will be observed that total costs rise sharply in the next four years 
to a peak of about 2,500 million C.F.A. francs in 1980 or three times the 
figure for 1975. After 1980 they fall rapidly, owing to the introduction of 
Solar cells, to about 1,300 million C.F.A. francs in 1982 and then reach 
2,000 million C.F.A. francs at the end of the decade. By the middle of the 
1980s, the main item of expenditure will be maintenance, and it might be 
Worth while to reorganize this service. Around 1985, in fact, there could 

* quite a large number of private televisions, making it possible to call 
On repairers from the cities, towns and even villages. In addition, the 
development and introduction of a model requiring very little servicing 
Could be speeded up. y . 

Our conclusion is that, in spite of uncertainty surrounding some of 
the assumptions, and after a few difficult years (1978-81), a general level 
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Unit costs in thousands of 1975 C.F.A. francs 
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TABLE 12. Overall reception costs (in millions of 1975 C.F.A. francs) 


Television sets, Power supply 
Year masts, aerials, (cost to primary Maintenance Total 
accessories education) 
1971 192 72 170 434 
1972 161 133 328 622 
1973 256 224 334 814 
1974 209 261 384 854 
1975 195 290 394 879 
1976 288 215 474 977 
1977 294 302 536 1,132 
1978 453 650 580 1,683 
1979 426 599 637 1,662 
1980 524 1,184 658 2,366 
1981 498 916 795 2,119 
1982 437 140 733 1,310 
1983 585 102 759 1,386 
1984. 588 65 792 1,445 
1985 761 36 816 1,613 
108b 734 172 832 1,738 
1987 835 145 872 1,852 
1988 Our 42 914 1,758 
1989 732 36 958 1,726 
1990 874 30 1,041 1,945 


ee ee EU me ee TOM LEM etam ed 


Of costs is reached which is perfectly bearable and appears to justify 
retaining and continuing to develop the school television programme. We 
would perhaps recommend starting fewer new classes in the three crucial 
years (1978-81) and making up the lost ground in the three years after 


that (1982-85). 


Production and broadcasting costs 
r schools raises important problems of 


method. It has, in fact, already been mentioned that the production 


services, located at Bouaké, are part of a large centre which, in addition 
to Producing programmes for schools, produces documentary material 
s: Centre d’Animation 


and provides, thr thr arate organization 
vides, through three sep CAFOP), École Normale d'Instituteurs 


€t de Formation Pédagogique c 
(ENT), Section de nec eds en Technologie Éducative (SSTE), for 
the training of teachers. 

Until recently, the accounts o. 
that it is not always possible to deter 
allocated to cach one. A standard manage 
Only a few months ago and it is still too car 
these now indispensable innovations. 

Discussion with the various offic 


Costing cducational programmes fo 


f these divisions were kept in such a way 
mine exactly what resources were 
ment procedure was introduced 
ly for this report to draw on 


ials in charge of the Bouaké centre 
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left us with the impression that there was a strong tendency for each 

division to claim its independence. Without going into a detailed anal ya 

of the sociology of organizations, a few brief comments may be made: 

There is a historical explanation for all the divisions being at the same 
centre: PETV! was, so to speak, devised ‘as it went along’. : 

Coexistence encouraged somewhat lax administration: the staff enjoyed 
the obvious advantage of avoiding the rigours of public account- 
ability, of being able to arrange matters among themselves in an 
atmosphere where a blind eye was turned to abuses, wastage and 
mistakes. 

The much-needed introduction of stricter regulations is drawing attention 
to the disadvantages—or, from the standpoint of public interest, the 
advantages—of existing side by side, and could encourage the temp- 
tation to split away and become independent; 

This temptation generally takes the form of e 
the right, for example, 
in the pious hope of nev 

Such an ideal, that resource 
bilization costs are nil, 
over-equipment, due t 


ach department claiming 
to its own studios, vehicles and service staff, 
er having to compete for the use of resources; 
s will always be at hand, assumes that immo- 
which is far from being the case. Instances of 
o the fact that it is considered cheaper to buy 
a second set than to suffer the restrictions of sharing and using equip- 
ment in the most rational and efficient manner, have already been 
observed in the Ivory Coast, and in other countries too. From the 
micro-economic standpoint, it is easy to explain such occurrences 
since different officials are responsible for meeting the cost in different 
cases. But the person responsible for public funds must, of course, 
_ put the public interest first, 
This is why the natural inclination of senior officials in each department 
to recommend and seck a 


complete range of resources, even though they 
resisted. 


: estimate their mo 
: since change of status 
necessarily the physical input. In the case of the Ivory Coast, it would be 
fair to say, simplifying matters, that thi ge cost of a fore. = Dus 
assistant is at least twice as much as his nati SIRE 
a national government employee costs fou 


1. Programme d’Education Télévisuelle (Educational Television Programme) 
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worker, The process of staffing with ‘nationals’ is already under way and 
is, in theory, due to be completed in 1980, and there is a slight trend, the 
future development of which cannot as yet be forecast, for casual workers 
to acquire government-employce status. The former process tends to 
reduce costs and the latter to increase them. 


Total number of employees by category 
Table 13 shows the number of staff in each category since the programme 


started. 


TABLE 13. Staff categories at the Bouaké centre 


a N U Mm 


—- 1969 1970 1971 1972 1973 1974 1975 
Government employees 

Ivory Coast nationals — 19 49 fe 186 Po 
National casual workers ise 73 is - EN i ud 
Foreign technical 

assistants (French, 

Canadian, Unesco) 13 47 Bo T ut = z 


The table does not include persons seconded to DOGE (before 1975 to 
, to internal or external 


the Unité de Traitement de l'Information (UTI)) a 
evaluation services, to non-formal educational activities or to the Archi- 
tectural Unit, DOGE and the Evaluation Unit both work for PETV as a 
Whole and not just for the production division; non-formal educational 
activities are a separate matter and the Architectural Unit would have 


its uses without PETV. 

Clearly, the number of people employed at the Bouaké centre has 
grown very rapidly and a further seventy posts have been requested for 
the 1976/77 school year. Present numbers are already far in excess of the 


initial forecasts. A 

These requests for additional staff can be partly explained by the 
fact that the Bouaké centre is getting ready to produce programmes at the 
Secondary level for the moment when the first generation of television 
learners enter the first year of secondary education in September 1977. 
5, however, is only one of several possibilities and, what is more, the 
Present report is concerned with estimating the costs of television for 
Primary education only. We shall therefore fix staff requirements at the 
1975 level since, from 1977 onwards, the centre will merely have to revise 
Already recorded programmes as all those needed for the six years of 
Primary education have been produced at least once. The staff is prob- 
ably a little larger than necessary; but it is not possible to state to what 
extent, 


In addition, when assessing the costs, we shall be unable to make a 
> 
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precise allowance for the process whereby casual workers become gover- 


ment employees and thus increase costs, though this might be counter- 
balanced by reductions in staff. 


Number of employees by division 


We shall examine the number of employees in each division for the 
year 1975/76 (Table 14). 


TABLE 14. Staff structure by division 
ee eee ee 


Technical a S 
5 Technical National 
‘maple ety " assistants — government EUM. Total 
eas lcs (Canada) employees ` 
General Directorate 
and Administration 5 — 38 88 131 
Written materials 
—production — 13 5 9 27 
Written materials 
—printing — 13 5 72 go 
Education 31 — 46 — 77 
Sub-directorate of 
audio-visual technology gı — 46 56 133 
Evaluation 3 — 8 4 15 
Training 304-7 — 25 30 92 
Toran 


107 26 173 259 565 


The General Direc 
employed in joint servi 
men and multi-media lib 


r u r i ivision is concerned 
with planning the television programmes and is inclu 
duction costs, 


Production costs: operation 


training; (b) ascribing a pro ortion of th 
ation Unit, DOGE, : deer 


the production Sector, 
which uses a studio a; 


Se i TOporti 
of the divisions that use them, Proportion to the 
Lastly, 
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to the direct costs of the various PETV sectors: reception, production, 
written material and training. 

The direct production costs in 1975 for technical assistance and 
national government employees amount to 286 million 1975 C.F.A. 
francs, for accommodation for technical assistants! to 62 million (31 million 
in the Technical Sub-directorate and 31 million in the Educational 
Division), and for equipment and casual workers, to 190 million, making 
à total of 538 million. 

The joint services and central administration costs in 1975 for 
national personnel amount to 37 million 1975 C.F.A. francs, for technical 
assistance to 39 million, for accommodation for technical assistants to 
5 million, for equipment and casual workers, to 118 million, and for 
electricity, water and telephone, 21 million, making a total of 220 million. 


TABLE 15. Distribution of the costs of joint services 
and general administration at the Bouaké centre 


o ee hs eee 2 Se ES E 


Share of joint 


Direct costs r 

(in millions Percentage services and general 

C.F.A. francs) administration costs 
Written materials 480! 37.2 82 
raining 273° 21.1 46 
Production 538 41.7 92 
TOTAL 1,291 100.0 220 


1. See Table 21: sub-total of direct expenditure. 


2. Sce Table 19: sub-total of direct expenditure. 


R The cost of central services (excluding the Bouaké centre) for tech- 
nical assistance is 56 million C.F.A. francs; for accommodation of tech- 
nical assistants, 16 million; and for equipment and casual workers, 


46 million, totalling 118 million. 


Taste 16. Distribution of the cost of central services 
(excluding those at the Bouaké centre) by sector 


Direct costs Percentage of Share of 4 

(in millions of total central service 
G.F.A. francs) direct costs costs 
Werption 952 42.4 50 
Titten materials 480 21.4 25 
Training 273 12.9 14 
meen 538 24.0 28 
100.0 118 


es ER 2,243 


1. The cost of accommodation for foreign technical assistants is estimated at 1 million 


C.F.A. francs per person per year. 
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When the costs of joint services and central services are added to 
direct production costs, the result is as follows: direct costs—529 million 
1975 C.F.A. francs, joint services costs—92 million, central services costs— 


28 million, making a total for operating costs of the Production Division 
in 1975 of 649 million. 


Production costs: investments 


Between 1969 and 1973, the temporary premises loaned to the centre 
were altered and equipped with electronic apparatus. The relevant 
accounts usually enable the costs incumbent on production, training and 
written materials respectively to be distinguished. 


We have therefore identified all the transactions during this period 
and then converted the figures into 1975 C.F.A. francs. 


1975 and 1976 and it is difficult to 
ch division. Tt is, in fact, impossible 
§ costs since the written materials 


8 50 per cent between ‘training’ 
© per cent), 


dios as being fe ducti n 
th p 25 pemg lor production alone, o 
€ assumption that the Training Division Will transfer their present 


(40 per cent) and ‘written materials’ (1 


Where the new studi a de : 

meeting in March 1976, dedided to c d, the Club d Abidjan, at its 
other in 1978. The chi 
yet been settled. Pre]; 


television sets for th hool: t 

udios. This technical we Schools, we Op 
argum, : 

nnual cost of im Sument is backed up by an 


P pep a 
colour is inevitable 2nd that the blackandewhi [ 
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TABLE 17. Investment costs for the Television Production Division 
(in millions of 1975 C.F.A. francs) 


Equipment and 
alterations of former 
television production ME e 
centre 492 107 178 13 68 — — 
"Total cost of a new 
centre ex des SS c (900^ (939^ Cu = 
Share ascribed to 
television production 
Fn oo 46 35 = 
Fe (5095) P= aub 4 Pa 80-600 80-600 
udio = 
Total investments for a -6 80-600 
television production 492 107 178 13 68 — 400 465 115 635 


Broadcastin à 
The oo - produced at Bouaké are broadcast by tae ana 
Télévision Ivoirienne network. A small team, based at Boua ze urs 
Sub-Directorate for Production, itn rer programmes to 
at Abidjan via the Bouaké-Abidjan radio link. c 
In” 1975, the RTI received 78 million C.F A n m i 
for use of their network. In a document submitte uo am 
16 November 1976, RTI announced its desire to € n Mns 
to 162 million C.F.A. francs, broken down as rep i a Luc es i: 
network maintenance (50 per gens 58.5 million; fuel, 30. ; 
a total of 162.2 million G.F.A. francs. —— 
This cee is arrived at by apportioning à ghana. ye 
between R'TI and educational television. Howen mae M 
ginal Cost, almost all the expense of servicing the igi nisi inia 
In terms of staff, there would remain a day per e Lrg 
"ue OTLA. Banes, aay el bile at 1o 
a Han m" .F.A. » 
1 pore oe a pre e in the Ivory Coast budget, 


TABLE 18. Number of hours of broadcasting 


1971/72 1972/73 1973/74 1974/75 

6 5.0 

CE 119.0 90-5 94 95-0 
95-0 7-4 
CE? n — 80.0 73.0 
cE: = — = 58.0 
CE 2 d 
Training and re-training of à: Tm 
teachers 73.0 112.0 


a 0.7 397.0 
Toran 192.0 297-5 34 
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taxes are an internal operation, not a cost. We therefore esti- 
es the real cost of fuel at 15 million C.F.A. francs. The marginal 
cost incumbent on educational television can thus be estimated at 
73-7 +15—11.7=77 million C.F.A. francs, which is nearly equivalent 
to present payments. The number of hours of broadcasting are as shown 

in Table 18. . 
In 1975, when fees of 78 million C.F.A. francs were paid to RTI, 

the cost per hour of broadcasting was 196,400 C.F.A. francs. 


Other costs of the reform: training, re-training 
and written materials 

Training and re-training of teachers 

Most cost studies of educational television in 
expenditure on the training and re-training of schoolteachers at the 
Bouaké centre but usually exclude expenditure on training at the other 
CAFOP centres. This raises an important question of method which needs 
to be discussed. 


the Ivory Coast include 


A (a) to seek to isolate the specific 
costs of the PETV in relation toa traditional education system, and (b) to 


Both approaches are of interest but, if 
the Ivory © 


Important to know the 
larly, if it is desired 


additional costs ( 
television, rather 


advance the following hypotheses: Y case. It is possible, however, to 


Without PETV, teacher training would h: 


it does now, since one of the PETV 
the problem of inad 


powerful teaching aj 
Hence, the costs incurr 


ive lasted at least as long as 
objectives was recisely to solve 
equately Qualified teach, E » 


ers by giving them a 


Classes; production 
Ing or re-training 
for the training oF 
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However, most of these items have already been covered under the 
various cost headings already examined: reception, production and 
broadcasting. 

The only things not yet accounted for are a closed-circuit television 
and studio installed at the Bouaké centre for teacher-training purposes 
exclusively, and the training of staff in audio-visual techniques. 

In our view, the closed-circuit television is not a consequence of 
PETV but springs from more general educational considerations which 
militate in favour of employing this kind of facility even in education 
systems not based on television. 

The training of audio-visual specialists, for its part, is difficult to 
Cost separately and it will be included with the other training costs, of 
which it forms a very small part. 

The costs we are about to analyse are not, therefore, to be ascribed 
to television. They are the costs of a sub-sector of the Ivory Coast’s 
primary education system or of one of the elements in the renewal of its 


education system. 


"TABLE 19. Teacher training: 1975 operating costs 
(in millions of 1975 C.F.A. francs) 


Section III of the ENS! Ivory Coast personnel 6 
Technical assistants 16 

Accommodation for technical assistants 4 

Equipment and casual workers I 

Student allowances 37 

Sub-total ENS 64 

Bouaké Ivory Coast personnel 30 
Technical assistants 136 

Accommodation for technical assistants 37 

Equipment and casual workers 61 

Scholarships 9 
(Sub-total direct costs) (273) 

Share of joint services 46 

Share of central services 14 

Sub-total Bouaké 333 

Other CAFOP centres Ivory Coast personnel 103 
Technical assistants 247 

Accommodation for technical assistants 68 

Equipment and casual workers 163 

Scholarships 21 

Sub-total other CAFOPs 602 

TOTAL 659 


1. École Normale Supérieure (College of Education): this section is particularly concerned with 
training primary-education inspectors. 
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Written materials ak 
Just as many PETV cost studies include teacher training at Bouaké, a 
certain number regard the written materials as a necessary consequence 
of PETV, a kind of vital complement to the medium of television. This 
is not true. It would have been quite possible to plan the use of television 
without printing special documents to go with it. Moreover, the converse 
also holds because these printed documents have been distributed to 
certain classes not in the television scheme, thus implying that although 
television and the written materials are integrated as regards subject- 
matter and progression, their use together does not suggest a "n 
Whose inputs are inseparable, like coke and iron ore in the productio: 
of cast iron. D 1 
We shall regard the written materials as an independent Fi id 
Which, like television, is part of the reform of the primary e sii 
System in the Ivory Coast, and treat operating and investmen 
accordingly. 


TABLE 21. Cost of documentary support 
(in millions of 1975 C.F.A. francs) 


ee 


Investments 100 
Construction of buildings 180 
Proportion attributable to new centre (10 per cent) 390 
1975 value of material and equipment delivered 1973-75 20 
ther equipment E 
Torar INVESTMENTS 
Operating costs ( 1975) 18 
Ivory Coast personnel 228 
Technical assistants 26 
Ccommodation for technical assistants 124 
Materials: paper 31 
cardboard 23 
Others 3 
Electricity 27 
ther materials and casual workers 480 
UB-TOTAL: direct expenditure “82 
Share of joint services costs 25 
hare of Central services costs 7587 


ToTaL 
CT ee 


It will be noted that the sub-directorate for Us n Eg 
almost as much as the sub-directorate for eer bet ie is 4 poa 
ably appears less expensive to the Ivory Coast aw deeper ien od 

nanced by external long-term loans at a low rate 
act remains that it is a very heavy burden. 


i sts: 
cre ari asons for such high co : 
There is yg : pets of technical assistants who, neman 
eing Cardin and thus not Ivory Coast civil servants, are highly 
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paid. When Ivory Coast nationals take over this division, staff costs 
should fall considerably. 

The documents distributed to pupils are reprinted every year, even if 
the content is in no way changed, thus entailing a very heavy 
consumption of paper. 

This point has prompted discussion about the advisability of prolonging 

the average life of printed documents to two or even three years. 
According to DOGE calculations, the cost of paper and cardboard 


(not including transport and taxes) will, in the next few years, follow the 
pattern shown in Table 22. 


Taste 22. Evolution of expenditure on paper and cardboard 
(in millions of C.F.A. francs) 


Year Paper Cardboard Total Annual increase 
(%) 
pt 121 40 161 a 
1977/7 173 52 225 dean 
1978/79 249 64 313 i E 
1979/80 324 81 405 Hes 
TABLE 23. General reca; 


pitulation of the costs of television for primary education 


(excluding classrooms) (in millions of 1975 C.F.A. francs) 


1971 1972 1973 1974 1975 


1976 1977 
Reception 
, 434 622 814 854 87 1,132 
Costs p Operating 240 11 i 3H : 
related to / Production | per 2 a we “a i i 
television ; nvestments 7771 13 6 — 
Broadcasting 78 78 78 78 
ol 
à 1,529 — 1,024 1,466 1,484. 
Costs Operating costs 217 282 458 
related to Investments 100 = 3 4 499 
written Paper? — A xa 
terials praet 
s ip. " moral r 317 282 598 639 
Si 'perating costs! 370 480 780 850 
related to | Investments 2611 3 i Ed 
ane = 68 
pu. "Total 1 631 483 780 1 P 
otal other operating costs? 56310, 548410 2,74510 ; 10 
qr 5745 45117 


Ing costs i 
persons employed in each division, 3s a are estimated iam 
igure fo; 
in r971. 


in proportion to number of 
T 1975: 85 per cent in 1974; 


231 327 429 
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. These forecasts imply almost intolerable increases in expenditure 
since costs will triple in five years. They assume, it is true, that prices will 
rise by 10 per cent a year, which is perhaps more than a simple increase 
in costs although there have been, in recent years, big increases in the 
cost of paper on the world market. 

One obvious way of slowing down the rise in costs is to prolong the 
average life-span of printed documents by designing them so that they 
can be re-used. No country in the world, not even among the most devel- 
oped, has ever followed a system which called for printed documents to 
be Systematically renewed each year. 

In our view, a two-year life-span should make it possible to stabilize 
the manpower requirements of the sub-directorate concerned at their 
1975 level. 

In 1976/77 the foregoing suggestion could be put into effect: there 
Could be a gencral distribution together with enough extra copies 
for the 90,000 additional pupils (4-28 per cent) in the same classes 
the following year. This would cost 161 million multiplied by 1.28 
= 206 million C.F.A. francs. 

In 1977/78, as the same documents would be used by the next year- 
Broups, it would be possible to organize the new rhythm of production 


1986 1987 1988 1989 1990 


198 
CAM ME 1983 1984 1985 
3366. amo ngo 1,906 1445 1619 — 1738 © 1852 — 1758 1726 1945 
Ga M Mc M E MEE E HT 
B "d =š = 8o? 8 — ig 
ie 5 ~ B 8 78 78 78 78 
28 78 8 78 78 7 3 
x 2,784 1,875 "m 2,110 2,278 2,403 2,597 2,503 2,991 aie 
ue dd 56: 561 561 561 561 561 561 561 561 3 1 
 - 2 oo =o = E ES ~ 518 546 573 
3o! 66 42 
= 869 dod 1 E ide 1,117 1,018 1,049 1,079 1,106 1,134 
42 442 s 2,730 2,730 2,730 2,730 2,730 


3y 
UM 442 agga 2,230 — 2780 — 27739 


567 — = F 
“154 o 2,730 2,730 2,730 2,730 
3009 — 2442 2,530 2,30 2730 2730 2 
2 ^ 

a 32,031 46,208 Bod 45,700 5105: 56,729 62,02 68875 75096 80462 
38,693 7 ; 62,880 69,158 75185 81,263 86,936 


33, 
29? 38,695 41603 46,769 51696 55170 
1,106 


1,418 — 1,487 
800 876 951 1,025 1,187 — 1268 1345 4 » 


1-6. 1 million C.F.A. francs per traine 
and the intake capacity of the CAFO) 
rd Projedor 9, page 13, based on the num! 
É hit cost in 1975 (from document o! 
* + 1,249: impact of leaving the esta 
Salaries of teachers in relation to oth 


imary education. 
plied by number of television pupils. 
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needs of the next two years (1978/79 and 1979/80), but for 

aea classes (or half the subjects), the other half being produced 
p: poo in cost can be expected from this system? 

1f, as we believe, it is possible to meet requirements with the present 

staff, the only variable costs are those for paper, cardboard and m 

printing supplies. With the present system, these variable costs would, 

in 1980, exceed fixed costs if the latter remain st: 


able, whereas they come 
to only one-quarter of fixed costs today. Moreover, if, as is planned, the 
staff includes all Ivory Coast nationals by 1980, fixed costs will fall by a 


good third, making variable costs a third higher than fixed costs. By 


doubling the life-span of printed materials the variable costs are cut by 
half and decrease to about two-thirds of the fixed costs, themselves lower 
because the staff is now composed of nationals 


only. 
In short, this measure reduces the estimated costs in 1980 by a 
good 25 per cent. We shall return in Part 2 to a systematic study of the 
impact of each possibility on costs. 


Part 2. Cost functions, comparisons and outlook 


Cost functions 


PETV occasions certain Fixed costs, i.e. not dependent on the number of 
Pupils, while others are variable because they reflect Pupil numbers. If F 


represents fixed costs, V the per pupil and W the number of 


i variable cost 
pupils, the function of total 


cost (TC) is 
TC—F-Lyxw 

From this we derive the function of avera, t Ae ividi bove 

equation by the number of pupils (JV): — N i 


TC F 

NEw Y 
Where PETV is concern 
vision programmes, 
and broadcasting; 


written documenta: 
and classrooms). 


cd, the fixed costs cov 
ai «X gn (but not prir nting) of written materials 

arlable costs Telate to recepti inüng of 
Ty materials ang a ption, the printing 
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over the years whereas the cost of schoolteachers will tend to rise slightly 
because of progressively smaller average classes. " 
In Table 24 we have estimated variable cost factors by expressing 


investment expenditure as annual instalments at three alternative levels, 
depending on the bank rate. 


The use of a bank rate can be defended her 
were the expenditure financed through a loan, the annual repayments 
would include interest on the capital borrowed. But since, for onc thing, 
part of the equipment was given to the Ivory Coast, thus obviating the 
need to finance it, and for another, there exists no objective market rate 
to refer to, we have employed the rates proposed in previous studies. 

We have also used the same alternative rates to calculate the fixed 


investment costs in relation to the number of pupils (Table 25) 
The function of total cost in 1975 (assuming a bank rate of 7-5 per 
cent) is, therefore, 


€ on the grounds that, 


TC = 1,109,000 + 32,515 V 
from which the average cost per pupil may be derived: 


TC 1,109,000 
WU 82515. 


TABLE 25. Total fixed costs per year 


(in millions of 1975 C.F.A. francs) 


2 
2 Television production: 6 
S Production of written T 
bp materials? 
t 
E Broadcasting E 
9 TOTAL OPERATING 
[e] COSTS 821 
Annual Annual Annual 
Total repayment repayment repayment 
cost at o per at 7.5 per — ati15 per 
cent cent cent 
Television production 
a Buildings (fifty y 
z c Y years) oo 
E quipment (ten years)3 oe D 99 ie 
z Production of written si 137 i 
g materials 
Š Buildings (fifty years) 280 6 
Equipment (ten years) 410 41 ec ba 
TOTAL FIXED Costs PER YEAR 980 = = 
1,10 6 
1. See page 130. " bth 
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Similarly, total cost in 1985 will be 
TC = 1,109,000 + 49,559 V 
and average cost per pupil 


TC 1,109,000 4 
WN 1 49:559- 


. . The curve of average costs per pupil in Figure 2 is particularly 

Interesting because it clearly displays two phenomena: 

Average costs fall sharply until the number of pupils reaches 200,000- 
300,000. Beyond this threshold fixed costs are negligible; in other 
words, the Ivory Coast's experiment in education by television is, 
in 1976, on a large enough scale to justify incurring the extra fixed 
Costs arising from the usc of television; l i 

In 1985, the average cost per pupil will be quite a lot higher than in 1975 
because variable costs will have increased substantially. But when 
the structure of these variable costs is examined (Table 24), it 
emerges that between 1975 and 1985 the proportion relating to tele- 
vision and written materials will have dropped considerably whereas 
basic factors such as the remuneration of teachers (as a result of 


Average cost in 1975 C.F.A. francs 


80,000 i] 
75,000 
70,000 
65,000 
60,000 
i Average cost per pupil, 1985 
50,000 
48000 | 

4 


40,000 
35,000 
30,000 
25,000 ] 
20,000 

isoo] 
10,000 


5,000 Number of pupils (in thousands) 
3s 1 1 Eine. es 
1,3100 1,200 


Sei so don o0 aoo. doo. o iB. 200; BOO. 800" "1,000 


Average cost per pupil, 1975 


F 
IG. 2, Average costs per pupil. 
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ing i 1 lassroom overheads will have greatly 

d wh, pu Ede the cost of television, 12.4 per n 
ec costs per pupil = 1975, will have fallen to an almos 

We cope ie abi : $5 PETV reached a level of development 

* Ber E Faden associated with television are perfectly reasonable wm 
T E es when the system will be expanding, the country will regar 

Pas le ie issue as much less important than teachers’ salaries. In 1985, 

a oi traditional system of education is more or less expensive than 

Ke arene: on the media will no longer be the issue. Debate will Torus 
on example, on how a developing country is to finance 100 per cen 


i in 
enrolment of its future generations, or on the salary scale of teachers 
relation to other social categories. 


The financing of PETV 


PETV was launched with the help of many external sources of a 
including Unesco, the Coopération Française (Fonds d’ Aide a la Coop d 
ration (FAC)), the United Nations Children's Fund (Unicef), an a 
Canada. An International Bank for Reconstruction and pas. dien 
(IBRD) loan made it possible to finance the building of the new Boua 
centre. n f on 

This assistance is specific, each partner supporting a particular sect 
of PETV. Unesco has contributed highly skilled manpower and audio- 
visual equipment; Canada has financed the investments for the Lice i^ 
materials printing works and about thirty technical assistants to run it; 
Unicef h 


as contributed mainly to the training and re-training of school: 
teachers, and FAC has covered part of the cost of French technica 
assistance and half the cost of investments in audio-visual equipment 
(e.g. purchase of television sets). 


This assistance is 


; a process that is theoreti 
by 1980 though it is 


respected. 


are not given, it being 
ally diminish and reac 

Foreign aid was 
accounting for 60 pe 
diminished quite qui 


1. See Table 23, footnote Li. 
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TABLE 26. The financing of PETV (in millions of 1975 C.F.A. francs) 


1969/70/71 1972 1973 1974 1975 
& % < % é % < % < % 
Unesco 529 1752 251 77 290 38 148 rg 162. 14 
FAC 1,165 383 802 245 843 151 763 10.0 700 6.2 
Unicef 137 45 69 2.1 50 0.9 26 og — 
IBRD 332 29 
Canada = => 65 2.0 479 8.6 726 9-5 622 5.5 


Ivory Coast! 1,215 40.0 2,000 63.7 4,006 717 5:995 793 9473 _ 83-9 
5,589 100.0 7,658 100.0 11,290 100.0 


TOTAL 3,040 100.0 3,273 100.0 


1. The Ivory Coast figures include the payment of PETV teachers but not the depreciation of 


classrooms. 
Source: DOGE and previous tables (25 November 1976). 


When the new centre is finished in 1977, it will probably fall to about 
10 per cent and gradually stop altogether in the 1980s. N 

It should be added that specific assistance for project evaluation has 
been provided by Belgium, the United States of America and the Federal 


Republic of Germany. 


Resource allocation for education in the Ivory Coast 


Proportion o ional budget spent on education a 

ne pee tel ie great effort to develop education, but wi 
amount spent on PETV forms a relatively modest proportion of in: pr i 
The 1975 figures for all expenditure by the Ministry of National Edu- 
cation show that PETV accounts for only 26.3 per cent since the cs 
also finances traditional primary education, secondary and higher edu- 
Cation as well as subsidizing the private sector. 


ign aid, which passes via the Ministry 
aon D Ag cr ps d is added to PETV expenditure, 


9f Finance to pay foreign teachers, e 
the State devoid Bees - cent of its 1971 budget to pee: and 
that this proportion is now reaching 40 pcr cent. These figures do not 


include expenditure on education by other ministries, na as the 

inistry of Technical and Vocational Education which spends 3:0007 
4,000 million C.F.A. francs, representing an extra 3-4 per cenk ^w 
Countries are making such an effort for education; in France, for example, 


the equivalent proportion is about 17 per cent. 


The economics of new educational media: cost and effectiveness 
140 


Proportion of gross domestic product (GDP) spent on education 
Families sending their children to private schools pay fees. When these 
are added to the previous total, the total national resources devoted to 
education represents about 7 per cent of GDP. 

It should nevertheless be noted that this figure does not include 
expenditure on technical education (4,000 million C.F.A. francs) or on 


school-building by local communes (2,000 classrooms a year at 3 million 
each: 6,000 million C.F.A. francs) 


With these additional 10,000 
GDP in 1975—the total allocatio: 
9 per cent of national resources a: 
Scandinavian countries as a wor 


million C.F.A. francs——1:.2 per cent of 
n for education reaches between 8 and 
nd places the Ivory Coast alongside the 
ld leader in this respect. 

Future outlook 


Planned growth in expenditure up to 1990. Table 23 shows that, in 1990, 
expenditure on PETV will b 


: € eight times the 1975 figure. Calculations 
by the Service Autonome d'É de Gestion des Programmes Scolaires 
(SAEGPS) rtment, in conjunction with DOGE, 


"TABLE 27. Allocation of resou; 


Mocatic rces to education 
(in millions of G.F.A. francs) 
1971 1972 1973 1974 1975 
Ministry of Education 
ti: 

poraga Eu ate 19412 — 22,33 97,480 35,227 42,927" 

Total ane MEC Mes 

23,085 ^ 26,589 31 
s 1564 910 961 

Regular Budget of the State 65,700 7,77] à 39.9 47: ^ 
Percentage of Ministry of 399 106,732 120,9 

Educati 

lucation 35.2 36.5 36.5 374 39.6 

Private expenditure on 

educati 
retik Sg 916 1,082 1 1,673 

: 5965 6,605 2350 : 

Total expenditure on 7311 8,591 15,330 

education 8 
Gross domestic product Poo Sater 39,957 49,854 64,960 

(GDP) 
Percentage of GDP Ec 472,00 565,000 


739,000 — 814,000 


52 74 6.7 8.0 


1. 41,673 without upgrading. 
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grow as follows: primary and lower secondary education for 1975 is 
55 and for 1990, 440 while other levels of education equal 45 for 1975 
and 180 for 1990, totalling 100 for 1975 and 620 for 1990. 

__ Under present conditions, expenditure on education in real terms 
Will be multiplied by more than 6 in the fifteen years from 1975 to 1990. 

If, during the same period, GDP doubles in real terms, this means 
that the Ivory Coast will be spending three times more in proportion than 
today, or over 20 per cent of its GDP. If GDP is multiplied by 3, a very 
optimistic hypothesis, the Ivory Coast will still spend 15 per cent of its 

P on education in 1990. 

At present there exists no objective technique making it possible to 
call this allocation of resources irrational or impossible. It should be 
Observed, however, that countries spending more than 5 per cent of GDP 
on education—usually developed countries—increased such expenditure 
sharply during the 1960s but, since about 1970, have manifested a general 
tendency towards stabilization. This makes it rather unlikely that other 
Countries apart from the Ivory Coast are getting ready to exceed the 


10 per cent threshold in the next few years. 

If it is assumed that, for various reasons, 
Surpass ro per cent yet at the same time cannot resis t 
ures for maintaining the present access rate to secondary education and 
keeping the same growth rate in primary education, the only possible 
solution would be to allow inflation to develop at a higher rate than the 
nominal increases in teachers’ salaries, which account for over 80 per cent 


of education costs. 
Assuming that GDP doubles 


the Ivory Coast is unable to 
t the social press- 


in real terms, the general situation 
Would be as follows: GDP for 1975 is 813,000 million C.F.A. francs while 
for 1990 it is 1,626,000 million; education for 1975 is 63,000 million while 
Or 1990 it is 390,000 million, making a percentage for 1975 of 7.7 and 
Or 1990, 24.0. 

If these 390,000 million 
cent of GDP, the face value o 


C.F.A. francs are to represent only 10 per 
f GDP must be 3,900,000 million francs, 


OT 2.4 times its real value; this corresponds to a 140 per cent inflation rate 


Over the period as a whole, or about 6 per cent per year. In other words, 
M be maintained if the annual inflation 


f education alone is 6 per cent and if 


teachers receive no salary increases at all during the period, which would 


mean that their real income would drop by 60 per cent. 
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ji ‘upgrading’ - 

Med 2M (dn as the result of a governmental decision 
to grant teachers alone among government employees a substantial 
increase in salary (40 per cent). As at least 80 per cent of expendi- 
ture on education is used to pay teachers, total expenditure in 1990 
(390,000 million C.F.A. francs) would include 312,000 million for salaries, 
of which 40 per cent (125,000 million) is due to upgrading. This rep- 
resents 7.7. per cent of the real GDP (1,626,000 million). In other words, 
half the additional expenditure on education over the next fifteen years, 
which will triple in relative terms, may be put down 


to the decision to 
‘upgrade’ teachers and the other half to the expansion of the system 
itself. Without ‘upgrading’, the 10 per cent limit would have been 
exceeded by very little and a: 


n annual inflation rate of 2 per cent would 
have been enough to cover the expansion of the system. 


Comparisons with the Klees-Jamison study 


The Klees-Jamison study (1973 and 1976) deals with the same 
period of time ( 1970-90) 


but results in different overall and unit costs, 
for two essential reasons:—the projected number of enrolments, then 
1,100,000 pupils, has now been increased by 400,000;—'upgrading' has 
increased real salaries substantially so that 1975 costs are about 40 per 
cent higher. 


evi 1 written materials, disregarding the cost of 
training and paying teachers. 


dies differ as follows (in millions 


: 1972 francs for Klees-Jamison, 1 Eicher- 
Ori; J » 1975 francs for 
1975 1990 
Klees-Jamison Eicher-Orivel Klees-Jamison Eicher-Orivel 
2,518 2,813 3,313 xe = 
» 
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In regard to average costs for the television programmes alone, 
Klees and Jamison arrive at 3,882 1972 C.F.A. francs for the period 
1969-90 as against our 3,713 1975 C.F.A. francs. This odd similarity is 
again because different factors cancel each other out. 


General conclusion and recommendations 


Klees and Jamison came to the conclusion that the costs per pupil of 
producing television programmes were, in the Ivory Coast, somewhat 
higher than those of comparable experiments in other countries. This is 
mainly put down to the problem of supplying television sets with elec- 
tricity. Our view is that progress in solar-cell technology is gradually 
outdating this diagnosis, and yet the unit costs in our study are not 

Significantly lower. In our opinion this is for the following reasons: 

The output capacity for television programmes and written materials has 
been allowed to expand too quickly with the result that production 
is at present far—though it is difficult to state exactly how far—below 
the potential level, thus entailing high fixed costs. T 

A salary structure incompatible with the country's true capacities has 
been allowed to develop within the education system. The annual 
salary of a young teacher is over $5,000 whereas the per capita GDPis 
only $500, or a mere tenth of this. In France, for example, a teacher 
Costs about the same at the start of his career but the per capita GDP 
is also a 000, giving a ratio of 1: 1 as against IO : I. 

This salary se dicis T cost of the educational television pro- 

gramme but its major impact is on the cost of classroom teachers. 

In other words, while not denying the Klees-Jamison contention that 
the Ivory Coast educational television scheme is rather expensive in 


absolute terms, we should like to take a more balanced view of the cost 
i he overall cost of primary edu- 


by stressi Het : aie 
stressing that it is a marginal factor in prim 
cation, To illustrate this point, it should be recalled that a slight improve- 

during the period under review, from 44 


ment in the teacher/pupil ratio $ 
to 41.5 pupils per class would increase the cost per pupil by 5.7 per cent, 


or by about the same as the medium of television itself (production and 


roadcasting) ) 


General recommendations 


Suppl; +: . s ;, 

ly of electricity for the television recervers TR. 

€ cost of an 2 sens batteries willsoon be prohibitive; though we have 

en cautious in assessing the future of solar cells, our calculations suggest 

that, in 1990, their cost will be one-hundredth of its present level. Careful 
> 


attention should therefore be paid to the development of solar technology 
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ible. In addition, 
that the change-over can be made as soon as possib 

iod should be connected to the mains whenever possible (DOGE has 
noted irritating delays in this respect). 


ion of the system 
Tie Fleet ide source of power to another will take place at 
the beginning of the 1980s and put extra strain on the budget. We suggest 
that if enrolment objectives remain unchanged, fewer new classes should 
be started in 1979, 1980 and 1981 (1,500 instead of 2,120) and the lost 
ground made up in 1982, 1983 and 1984. 


Number of television sets per class 


The decision to equip each classroom with a television set was discussed 
by Klees and Jamison and by the Architectural Unit of the Ministry of 
Education, who both recommend one set for two classes. According to the 
Architectural Unit, the sound-proof housing within which the single tele- 
vision set for two adjacent classes would pivot would increase building 
costs by about 25,000 C.F.A. francs, or a quarter of the price of at tele- 
vision receiver, In other words, this solution would reduce expenditure on 


and save 136 million C.F.A. francs 


We Tecommend this solution so long as the 
construction cost: 


; additional classroom 
act 5 remain substantially lower than 
a television set, 


the purchase price 0 
Electronic equipment for the new Studios 
Without taki i 


í his is approximately the life of a 
studio we recommend continuine «+ Pproximately the li 

with * ta? : at 

the Bouaké production centre. 8 with ‘black and white equipment a 
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Pupil|teacher ratio 
No serious educational evaluation has yet shown any qualitative differ- 
ence between pupils in classes of 44 and those in classes of 42.1 

On the other hand, it is well known that smaller classes ease the 
task of teachers. Now that primary teachers are relatively well placed in 
comparison with other social categories, it appears difficult to justify a 
further improvement of their living conditions. We therefore recommend 
holding the staffing ratio at its present level (44), thus enabling a sum 
equal to the cost of the television medium to be economized. 


Written materials 
The cost per pupil of written materials seems high. This is because of the 


policy of annual replacement, the quantity of documents involved, the 
Cost of immobilized capital and the upward trend in the price of paper. 
here are several possible complementary or alternative solutions: use 
of the printing works for other purposes; reduction in the number of 
workbooks by transforming them into textbooks; a longer life for printed 
documents, 
Our estimates assume that the cost of pap 
halved, thus reducing by a quarter the variable costs o 


er per pupil would be 


f written materials. 


Broadcasting . 
The RTI networkis made available to educational television for six-and-a- 
half hours a day for the 200 days of the school ycar, that is, 1,300 hours 
Per year. In 1975/76 school television broadcasts totalled about 400 hours 

normally, are unlikely to exceed 


and, with the CM 2 classes functioning J o 
ide for educational television are 


500. In theory, then, 800 hours set ast : 
Not used coia ix be possibly employed for other levels. We stress this 
Point since the unused production capacity, whether for television pro- 
grammes, written materials or broadcasting, would make it possible to 
Provide other services whose marginal cost would be nil. 
. . Asecond problem to do with broadcasting is whether our approach, 
in terms of marginal cost rather than average cost; 18 legitimate. We have 
hout educational tele- 


M cete that the network would exist even — Jew ey genie 
I810n, tho i j | that country-wide television 

u, be objected M 

| pM 1 hours set aside for school broadcasts 


Would have taken longer and that the S 
restrict the freedom to broadcast for commercial ends. An even more 
Serious objection is that our evaluation of the Ivory Coast experiment 
cannot be compared with evaluations conducted in other countries with 
NO pre-existi i (sion network. 
-existing and available television n Cn ‘ 
Our wc ha however, may be explained by emphasizing two points. 
First, it was not possible to reconstitute the cost of equipping the 


valuation Association, especially A. Harry 
ein and John R. Mallea, An Empirical 


Stockholm, Almqvist & Wickseel. 


1 Sce the surveys of the International E 
Passow, Harold J. Noah, Max A. Eckst 
Comparative Study of 21 Educational Systems, 
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network. The invoice presented to educational television by RTI contains 
an incomplete average cost with no allowance for network depreciation. 
Second, a high proportion of network time is employed by educa- 
tional television, a factor which has very considerably reduced the average 
cost previously incurred by RTI alone. Should not this reduction be 
regarded as one of the advantages of introducing educational television, 
rather than as a net cost? 
This is why we insist on distinguishing between the always useful and 
as yet uncalculated average hourly cost of using the network, and the 


invoice representing the marginal cost of the service presented to educa- 
tional television by RTI. 


Acción Cultural Popular (Colombia): 


alternative methods for determining project costs 


Howard P. Tuckman and Teufik F. Nas 


year ending 31 December 1976 
Cultural Popular (ACPO), Fe 


I. J. Burkh, i ey. 
J ead, Government Budgeting, Chapter 6, New York, Wil 956 
5 » .I 2 
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: In a similar fashion, analysis ofthe expenditures or costs of an educa- 

tional technology project may serve to provide historical data so that 
other countries can decide whether to replicate it, to enable a project 
manager to know whether an ongoing project is spending within its 
budgeted limits, to facilitate choice among alternative projects, and/or 
to provide cost data for effectiveness analysis. 

Precisely because the data needed for management or accounting 
Purposes differ from those needed to evaluate project effectiveness, the 
initial Step in project evaluation is to determine the uses of the data. 
Where resource allocation issues are involved, cost analysis rather than 


expenditure analysis is required. 


Physical resource accounting 


At the aggregate level, analysts sometimes group projects in terms of the 
Physical resources they employ. We shall refer to this as *physical resource’ 
accounting. This is useful in cases where resources are scarce and public 
Policy imposes constraints on the particular quantity or type of resource 
that can be employed. It is also useful where a particular resource such as 
labour is in oversupply and where balanced growth depends on the adop- 
tion of projects which utilize this resource. pv 

, , Insomewhat less aggregate terms, this type of accounting is also used 
in international comparisons to reflect the relative intensities of resource 
use of a project or organization. For example, military analysts compare 
the number of missiles of the armics of the Union of Soviet Socialist 
Republics and the United States of America in analysing the resource 
claims that defence makes on the two societies.? Analysis of this type elim- 
Inates the need to allow for imperfect exchange rates or for other problems 
Caused by valuation of projects in terms of different currencies.? A disad- 
Vantage is that resource accounting implicitly assumes homogeneity of 
Inputs and thus makes no allowance for qualitative differences among 


them. None the less, properly constructed, a physical paguen peer 
Scheme can be useful in describing a project’s impact on world resources. 


Input accounting 


Expendi j lly collected for management and 
ae pce ded oe ome brad than those described above. 


Control purposes, using categories less c 
oe example the federal budget document for the United States reports 
A 


1. This is especially the case in developing ae where ae 3 pss » 
labour i t. See, for example, W. *- man bets ava, 
‘Balanced 22 and Economic Growth’, in D. K. Wilbers (ed), The Political 
Economy of Development and Underdevelopment, New York, Random oe 1973- 

2. C. J. Hitch and R. McKean, The Economics of Defense in the Nuclear Age, Chapter 2, 
New York ‘Athenum 1966. i 

3. For example, the existence of a large non-market sector. 
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such items as personnel, supplies, travel, etc.! A framework such as this 
enables decision-makers to evaluate alternative entities in terms of a 
common set of expenditure categories. If one entity has expenditures out 
of line with another’s, the analyst using this scheme is likely to reduce its 
spending. This procedure is a time-honoured one among management 
analysts and it facilitates the regulation of large agencies by a fairly 
limited number of personnel.? 

We refer to this type of accounting as ‘input accounting’ because it 
focuses on the various input expenditures made on behalf of a project or 
set of projects. 

Input accounting is of limited usefulness in project analysis; it 
focuses on what a project uses as an input rather than on what it outputs. 
It is far more useful as a means of determining whether funds were spent 
as they were intended to be, rather than as a means for exploring whether 
there was a better way to perform a given task or set of tasks. This 


approach is more useful for accounting than for economic planning 
purposes.3 


Functional accounting 


I. See, for example, Budget of the U.S. 


D.C., Governmen Jear 1977-1978, Washington; 


rocess and defence of 


Policits of th incremental budgeting 


e Budgetary Process, Boston, Mass; 
ah A ost framework as well as in 
à Int is more a criti A 

nique itself. In the “ritique of the way the technique 


bjection. 3 
New York, Bobbs-Merril, 
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with the organizational process and has been employed frequently for 
this purpose. Its use for resource allocation purposes is somewhat limited 
by the fact that it focuses on the allocation of funds across units rather 
than across outputs. This has at least two consequences. Where an organ- 
ization produces a single output, this framework fails to relate the inputs 
used by each organizational entity to the outputs it produces. Likewise, 
where an organization produces several outputs, this framework usually 
fails to provide data on how the expenditures made by each entity relate 
to each of its outputs. Thus, it is difficult to discern from this accounting 
framework whether output could be increased by shifting resources from 
one organizational entity to another or which alternatives are available 


to perform a particular task or group of tasks. 


Educational input accounting 


This involves a breakdown of project or organizational expenditures 
according to the type of educational delivery system used. We refer to 
the various media used in this context as ‘educational inputs’. Thus, 
educational input accounting’ represents à fourth accounting scheme. 

Educational input accounting is uscful in analysing the amount of 
funds that an organization spends for different types of educational media. 
Ideally, a classification scheme which reveals the relative amounts spent 
9n each input would indicate the value attached to each of the inputs by 
Project decision-makers. This would be the case where the marginal 
Contribution to output of each input was known and if cost, rather than 


expenditure, data were used in this context. Unfortunately, the contri- 
d to provide education to the 


ution of each of the delivery systems usec, | pud 
user may not be known with sufficient precision to suggest that decision- 
Makers choose a particular configuration based on an output measure. 
ore likely, the rates assigned to each of the educational inputs reflect 


Institutional ui historical circumstance. 
d torica. circu 
Lago n is likely to be favoured by those 


. _ The educati i framework u 
In fields that ace eee educational technology delivery systems, 
specially those in communication.’ Since this framework provides data 
9n the expenditures made for each of several delivery systems, 1t 1s appro- 
Priate for analysis of the difference in the way that organizations employ 
new forms of technology. It is also helpful in enabling those contemplating 
is use of a particular delivery system tO gain an idea of what it might 
St, 
As in the case of the earlier fram 
is -—m no Formal y Desarrollo Nacional: 
Le d Bramy “Comair ap, Boko ACC, 6I S. Dese, i 
Medios Masivos de Comunicación al Servicio del Desarrollo Rural E roy 
Bogota, ACPO, 1974; S. Musto, ‘Los Medios de Comor en = A a 
Servicio del Desarrollo Rural. Análisis de Eficiencia de AC adio Sutatenza', 
Ogota, 1971. 


eworks, educational input 


Educación 
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accounting provides little guidance as to which form of technology is the 
most efficient and it is of limited value from the point of view of decision- 
making. Unless the ultimate question faced by the decision-maker is not 
which output to choose but rather how much to spend on each educa- 


tional input, this framework diverts attention from the ends of policy and 
focuses instead on the means. 


Programme cost accounting 


A fifth form of accounting scheme involves the costing of programme 


outputs. This method, known as ‘programme cost accounting’, requires 
that the researcher identify the out 


(or from society’s) point 
the inputs of a programme. » the focus is on the outputs, not 


are talking about a I 


ation rather than a smal arge multi-output organiz- 


t. None the less, the need 


2. The executive ord, 


" ings of these techni 
‘Cost-benefit Analysis and th PUE 
Literature, September 1969. ESSI uS uw 
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ed this approach to identify the outputs from a dollar of additional 
PS creates problems which do not exist with the other cost modes 

- Bec, Sa i ries may also require data that are not available to 
Mk spin. z or that are costly to obtain. As a result, the output cost 
Pn de i y be (i tiger subjective. The argument is also made that 
mess. ence o better effectiveness criteria, it is difficult to choose 
it T > eie programmes, especially at the aggregate level. While 
ex |J *» efficient to choose between bombers and foot soldiers on the 
i e number of enemy killed per dollar expended, no easily derived 

asures exist for evaluating the effectiveness of a range of spending pro- 
grammes in basic and health research, income maintenance, and certain 


regulatory areas. 

teks 1s our belief that the programme-costing approach has value in 

(hes evaluation, especially in dealing with educational technology 

Lm n I which produce several outputs. While each of the above objec- 

icis as merit, most projects are undertaken in an environment where 

e. ces are scarce, particularly in developing countries. Within this 
ntext, the choice among competing programme outputs is likely to be 


ani . A 
important, albeit not a simple, one. 


Technology components accounting 


designed explicitly for evaluating 


Our final classification scheme has been 
se is to provide a standardized 


ae radio projects. Its purpo 1 
i for international projects in terms of programmatic compo- 
S such as production, programming and distribution. "Technology 
Components accounting! is quite useful where a project has a single 
Output, Where multiple outputs are involved, the same objection may be 
made to this procedure as to the input accounting classification described 


above, 
This approach is valuable because it enables those interested in 
ake comparisons in terms of 


a S : 3 . 
nalysing instructional radio projects to m aris € 
ree types of activities. In this sense, 


fow their costs were split among the th à 
makes explicit the trade-off among the alternative uses of scarce funds. 
aralleling the work done by Jamison ¢ al., a framework of this type 
enables researchers to produce somewhat crude cost functions which 
relate the variables likely to determine costs to the actual costs of a 


Project.2 
The components accounting approach is best suited for analytic 


1. See J.-C, Eicher, ‘Cost-effectiveness Studies Applied to the Use of Educational 
Media’, P- 71-36} and F. Orivel, ‘Standard Tables for Cost Measurement’, 
P. 26-35 in The Economics of the New Educational Media, Vol. 1: Present. Status of 
Research and Trends, Paris, Unesco; 1977 (Educational Methods and Techniques, 1). 

3. D. "T. Jamison, 3. J. Klees and S. J. Wells, Cost Analysis for Educational Planning 
and Evaluation: Methodology and Application to Instructional Technology, Princeton, N.J., 

Educational Testing Service, 1976. 
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rather than for accounting or management purposes. For this reason, it 
is likely to appeal to those most interested in evaluating the determinants 
of differences in costs among instructional radio programmes. Its major 
supporters to date have been economists, although engineers concerned 


with the design of radio projects might also find the data obtained by this 
approach useful. 


While components accounting is desi; 
of instructional radio or radio sc 
does not enable the analyst to explore the question of which among 


several alternative media forms might be best for providing a particular 


outputs. For this reason, it appears to 
ation issues between media. How- 


T measures discussed above, its focus 
than the outputs, 


A specific application of the alternative cost frameworks 


the Process it hi Š tor sae 
: Sroup. It applies a guid ganed useful insights in 


ent and not an end in itself, 


1. This grant was 


nt was given to the C " 
State University in "ies enter for Educational Technology at Florida 
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^ In pursuing its objectives, ACPO has developed an infrastructure 
which extends country-wide. Its transmitters broadcast throughout 
Colombia; its newspaper El Campesino is distributed even in the sparsely 
populated regions of the country. ACPO's leadership training institutes 
provide a comprehensive programme for community leaders; its corre- 
spondence programme provides feedback from the campesinos on all phases 
of the operation. Few other organizations in Latin America have devel- 
oped as intensive an approach to the education of the rural poor; none 
have articulated their philosophy as extensively as has ACPO. 
The ACPO organization is privately owned and operated. Chartered 
as a private foundation by the Colombian Government in 1949, it exists 
, With recognition from both the Church and the State. Its board of direc- 
tors is composed of persons from education, industry and commerce in 
Colombia; it also has an advisory board made up of officials from the 
Colombian Catholic Church. Because ACPO is private, it cannot count 
on financial support from the government. It received aid from the 
Colombian Government from 1954 to 1975- 
ACPO's need to raise a portion of its own revenues has had several 
Consequences for its operation. It has been forced to find internal sources 
of revenue to finance itself. Since rural farmers in Colombia have only 
limited resources to support ACPO, the organization has established an 
elaborate commercial operation to support its rural activities. ACPO sells 
advertising on its long-wave and short-wave radio broadcasts and through 
the newspaper. Its business subsidiary, Editorial Andes, prints calendars, 
books, Christmas cards and boxes for children’s toys, and its record press 
Produces popular records. It also produces educational records containing 
the lessons broadcast by ACPO's radio stations. $ j 
For present purposes, it is sufficient to note that substantial reliance 
9n commercial activity as a source of revenue distinguishes ACPO s oper- 
ation, at least in degree, from the other radio schools in Latin America. 


Overview of ACPO's educational inputs 


ACPO currently employs is not the 
Instead, the input configuration has 
in what is needed to bring the 


literate people. The choice of 
r providing education was made 
onse to ACPO’s need for 


The educational input mix which 
one initially chosen by its founders. 
evolved as ACPO has gained experienc 
elements of a basic education to non- 
instructional radio as the primary form fo 
at the outset of the programme, largely in respo 
a medium which could reach people in inaccessr 


t first, education was provided via a small trans 1 ^ ; 
2 very limited range. The jnitial group of 120 listeners received instruction 


™ groups, using borrowed radios to tune in to the transmission. In sub- 
Sequent years, ACPO has imported and sold low-cost radios to encourage 
? 9s 
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listener participation. It has also increased the size of its facilities. The 
current instructional radio configuration involves both A.M. and short- 
wave transmission facilities and ensures virtually 100 per cent coverage 
of the potential audience. 

A second educational input used by ACPO involves a set of topical 
booklets covering the five major output areas. Designed with the assistance 
of Unesco experts, these provide basic instruction through simplified con- 
cepts and graphics designed to stimulate the interests of the campesino. 
Despite their popularity and strong evidence that they are highly regarded 
by the campesinos, they have not been altered or added to in the last eight 
years. 

El Campesino, the ACPO newspaper, was a comparatively late 
addition to the scene. Prior to its inception, ACPO produced several 
publications, primarily to reach its radiophonic school monitors and 
advanced pupils. The idea of a newspaper to reach the population served 
by ACPO came later. It was appealing precisely because it both promoted 
communication and identification among campesinos and provided edu- 
cational information. The newspaper contains stories involving the con- 
tent of each of ACPO’s learning areas as well as other features. It also 
contains supplements which deal with special issues selected by ACPO 
No other newspaper in Colombia addresses itself exclusively to the tam- 
pesino and his needs. 

Educational phonograph records containing the basi i 
taught on ACPO’s instructional radio broadens were Cien eei ii 
in 1974. These enable campesinos unable to listen to the radio to h: 
access to the basic instructional materials of ACPO, M 


A correspondence programme provides a source of communication 


between the campesinos and staff in the Bogotá facili i 
encouraged to correspond with ACPO shout thie “hry des chin hile 
using other instructional inputs. The correspondence is usually a. ki 
by regional staff located in ACPO's central office. SUM 
Perhaps the most important support activit 


and one which also serves as a lear 7 eloped by ACPO, 


These are the elements of ACPO’s deli 
H J li 
evolved historically. Together they form the seeds 


Y System as they have 
delivers its educational message. 


m through which ACPO 
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The tabular presentations 


For the purposes of our presentation, certain modifications are made in 
the classification schemes listed above. A major change is that a cost- 
based budget rather than an expenditure budget is used for the five- 
budget frameworks involving dollar figures. The primary difference 
between an expenditure and a cost approach is that the former treats 
capital costs on an annualized basis, excludes expenditures which do not 
involve the use of real resources, and eliminates certain accounting items 
for interest and depreciation. The resulting estimates more closely rep- 
resent the actual claim that ACPO makes on resources than do figures 
derived from the usual accounting entries. 

Because ACPO has a commercial as well as an educational function, 
the figures shown in each of the budgets must be analysed carefully. In 
the tables involving aggregate comparisons, i.e. the physical resources, 
input, and functional accounting budget, the figures include the com- 
bined costs of the commercial and educational enterprise. In the edu- 
cational input—programme costing and components analysis—only the 
educational elements are included. We have followed this procedure to 
conform with the needs that each of these presentations is intended to 


meet. 
Finally, the reader is cautioned that our figures are the 
December 1976 operating costs of the organization. Given the lack of 
f ACPO, it was impossible to recon- 


historical data on the operation of. 
struct historical costs.! Thus, our estimates represent a snapshot taken at 


a moment in time, not a reckoning of full project costs. 


Physical resource accounting 


The purpose of physical resource accounting is to provide quantitative 
TAE D A on the citar resources employed by an organization. Like 
other large organizations, ACPO has accumulated a substantial number 
of resources in thirty years. Its inventory sheets alone number over 
2,000 pages. For present purposes, We have chosen to list only the on 
and most important. In the cost estimates which follow, however, we have 
included a price for each item in the ACPO inventory. To facilitate the 
analysis, the resources are divided into the aggregate capital and os 
Categories. They are further subdivided by each of the twenty-one 
divisions, identified in terms of their organizational functions. 


of ACPO’s 


s b tructi 
1. Data could be obtained back through the early 1970s by reconstruction scene 


actual expenditures from bank records. Beyond this point, however, 
ditures become difficult to trace. 


The economics of new educational media: cost and effectiveness 


156 
Manpower requirements of ACPO 


Data on the number of persons employed by ACPO and on their costs are 
derived from personnel records as of 31 December 1976. All employees 
except those unpaid personnel who are dirigentes, or immediate auxiliaries, 
are included. The exclusion of the latter two groups is due to the lack of 
accurate records on how many persons are employed in these activities 
and the duration of their employment. 

The possibility exists that our figures understate the true manpower 
requirements of ACPO since they ignore persons on the pay-rolls during 
some part of the year but not employed on 31 December. Given the high 
unemployment rate in Colombia, and the low turnover at ACPO, this 
figure is not likely to be greater than 2 per cent of the tota. 
used by the organization. 

Table 1 shows the number of emplo 
ision of the organization. The data are 


1 manpower 


101 tity supervises 
ders, dirigentes, and supervisors, 
answers correspondence, and serves as ACPO's liaison wi i 


] v A with units in the 
field. The Planning and Evaluation Divisi 
Division, are low-cost divisions relativ 


TABLE 1. Distribution of ACPO manpower by division 


Division Number of Cost Percentage 

employees (in 1976 U.S.$) of total 

E AU M 

Administrative services 114 373,28. 
Planning and evaluation 15 ae gd 
Sales, design 20 51,454. A 
Printing press 166 334.304. E 
Record press 10 16,015 3 
Radio stations 


0.9 
119 226, 
Institutes js 


13.8 

Cultural divisions Es [d So 
Regional divisions 331 286,363 s 
Other support services 21 25,274 "a 
Miscellaneous services pea 114,614 E 
E ANS 9 

TOTAL 859 1,643,192 100.0 


Source: ACPO personnel records, December 1976. 
1. We provide a rough measure of the value of these r 


M Csources in our hj 
estimates for ACPO at the end of the chapter. T high cost 
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former deal solely with educational activities; the latter deal mostly with 
the promotion, sale and distribution of ACPO materials. 

The fourth largest user of labour, measured in terms of dollars, is 
constituted by the radio stations. It is interesting to note that this category 
has comparatively few persons assigned to it; 119 as compared with 166 in 
the printing press unit. The labour costs in the institute category include 
teacher’s salaries, scholarships for trainees, and all other related outlays. 
The entry for the cultural division includes the salaries both of employees 
of the cultural division and of teachers located in ACPO’s central office. 
Finally, the regional division category contains the salaries of those 
employees in the central departments and zone offices who provide com- 
munication services to staff and campesinos in the field.! 


Capital items 


Table 2 displays the major capital items and their costs measured 
in 1976 U.S. dollars.? It provides a physical description of the resources 
sea by ACPO and is an invaluable source of the data for the following 
section. 

Although we have made a concerted attempt to identify all of the 
resources used by ACPO, certain items remain outside our accounting 
framework; the amount they add to total costs, however, is not likely to 
exceed 20 per cent. They include the labour and capital items donated 
by campesinos and not carried on ACPO’s records; time spent by non- 
ACPO staff in establishing and attending the radio schools, and the space 
and other support services provided to ACPO by persons in religious, 
governmental and local community organizations. We have also made 


1. Except in the case of the radio stations and cultural division, the employees 
in these divisions allocate 100 per cent of their time to educational activities. 
The radio stations utilize 46 per cent of their employees’ time for educational 
activities, whereas the cultural division’s employees devote 80 per cent. 

2. Data on both the number of capital items and their value are obtained from 
a special document prepared in 1976 by ACPO for the World Bank: Acción 
Cultural Popular, 30 Años, Un Sistema de Medios de Comunicación Social al Servicio de 
la Educación del Campesino Colombiano. This volume contains information on the 
major ACPO equipment and building cost items. It excludes start-up and 
installation costs and minor capital items. The ‘equipment’ category includes 
transportation items that last more than one year and such items as mimeograph 
machines, transmission equipment, phonographs, slide projectors, radios, etc. Our 
data for each entry in this category include the purchase price, current market 
value, and estimates of the useful life of each piece of equipment employed 
by ACPO. The ‘building’ category covers all buildings used by the employees 


for ACPO purposes, whether rented or owned. s 

Other capital items such as vehicles, furniture, machinery, and laboratory 
equipment, etc. are obtained from a physical inventory prepared during February, 
1977. This inventory lists all physical assets owned by ACPO and the value of 
cach. The data that we report are derived from this inventory with several changes 
made to more closely reflect the market rather than the book value of each item. 
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TABLE 2. Dollar value of capital items used by ACPO in 1976 
————————————————— 


im Description Cost (U.S.$) 
Transmission facilities 2,055,407 
Radio Bogotá 250-kW transmitter 571,820 
50-kW transmitter 171,546 
25-kW transmitter 100,069 
10-kW transmitter (2) 108,646 
187-m. antenna tower 28,591 
F.M. link 51,464 
Telex 2,287 
Laboratory 
equipment 
Radio Medellin Yo annie dears 
3 . 200-m. antenna tower 36,025 
Radio Barranquilla 10-kW transmitter 51,464 
120-kW transmitter 285,910 
15-m. antenna tower 2,287 
jm antenna tower 4,289 
156-m. antenna tow: 
Radio Cali 120-kW transmitter x E 
sazie 204-m. antenna tower 37,168 
Bogotá 142,955 
Barranquilla eid 
Medellín "pm 
SER 28,591 
Buildings SRM 
Radio transmission lido 
Institutes 617,966 
Central services i 
Printing press 618,939 
Other 74,108 
Machinery and equipment 265,553 
ie Pi 
etw J 10,773,854 
pis s ag ilen 30 Años, Un Sistema de Medi: 


o5 de Comunicación Social al Servicio de la Edu- 


RAES 
tano, internal document, 1976; and ‘ACPO. Physical Inventory’, February 1977. 
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areas. The regional distribution of studio facilities should also be noted. 
Viewed in terms of capital resources used, these figures suggest that, at 
least as it is now organized, ACPO is an expensive organization.1 They 
also suggest that the larger capital items are primarily related to the radio 
transmission and to the commercial printing operations. We shall discuss 
these points further in the analyses which follows. 


Cost breakdown by input category 


The input accounting approach is useful in evaluating ACPO from the 
perspective of the types of broad categories of inputs which it uses. In the 
presentation that follows we shall modify the traditional input budget 
so that the entries in each category represent costs instead of expenditures. 
This will facilitate comparisons among the various budget alternatives. 

Table 3 shows the annualized operating costs of ACPO broken down 
by major resource input categories. The cost figure for the ‘labour’ 
category is taken from Table 1. Annualized operating costs for supplies, 
transportation, and the overhead and other categories are taken from 
the ACPO operating budget and allocated on the basis of conversations 
with ACPO staff. The ‘supplies’ category contains only expense items 
which last less than one year such as paper, pencils, etc. The ‘transpor- 


TABLE 3. Annualized ACPO costs by input category 
a a ee N ee 


itm 1976 U.S.$ Percentage 
pert 1,643,192 34-9 
Buildings: "496,292 10.6 
Supplies 957,517 204. 
Equipment! 810,775 17.2 
Transportation 189,062 4.0 
Overhead and miscellancous 608,477 12.9 
Torat 4705315 100.0 


1. The figures in this entry represent the capitalized amount for this category. 
Sources: Tables 1 and 2 and ACPO's operating budget, December 1976. 


1. The capital cost figures included in Table 2 are based on ACPO's own evaluation 


of cach capital item. There are several reasons for believing that 
ace bli: it d unlikely that the ‘market’ values used by ACPO include 
installation costs; (b) a country seeking to replicate this configuration would use 
more modern equipment which is likely to be more costly; (c) given the high 
rate of inflation in Colombia in the last few years, the buildings owned by ACPO 
are likely to be under-assessed. We shall consider a higher cost estimate at the 


end of this chapter. 
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tation’ category includes per diem and travel expenses related to ACPO 
activities plus amounts paid for the transportation of goods and services. 

Items with a lifetime longer than one year are treated as capital 
goods and annualized in accordance with different time periods for each 
type of assct.! For buildings, the average expected life is estimated to be 
thirty-five years; for transmission equipment, machinery and average or 
new furniture, fifteen years; for old furniture and studio facilities, ten 
years; and for miscellaneous equipment, five years. These time periods 
are based both upon joint discussions with ACPO staff and guidelines 
applied in previous cost studies.? A discount rate of 10 per cent is used 
in annualizing the capital items.? 

The ‘overhead and miscellaneous’ category contains items not classi- 
fied elsewhere, such as: advertising and publicity, electric power and 


a real resource cost directly resulting 
ally, interest payments, net of com- 
ed in our cost estimate; some capital 


of the issues see R, F, Mikesall, The 
Washington, D.C. i i t 

4. It is likely that under th 
field. This would at least partially affect «| 


use less labour in the 
force by an amount difficult to determin 


he Pay-roll of ACPO, reducing the field 
€ in the absence of better data. 
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as a church-related organization. Persons affiliated with this type of 
activity almost surely receive spiritual as well as monetary rewards. 
Second, the ratio of capital to labour will vary depending on which 
discount rate is used to annualize capital costs. A 7.5 per cent discount 
rate changes the ratio of capital to labour to 50 per cent; a 15 per cent 
discount rate changes the ratio to 95 per cent. 

It should also be noted that these figures fail to reflect the intensity 
of utilization of each factor. A highly labour-intensive operation may 
none the less show a large ratio of capital to labour costs if capital is 
scarce relative to labour. It seems likely that this was the case in Colombia 
at the time of our evaluation since the government restricted the amount 
of capital that could be employed in the private sector. 


Cost breakdown by functional accounting category 


Table 4 provides a breakdown of total annual operating cost by division.! 
Once again, the figures include overhead which ACPO incurs, rep- 
resenting about one-fifth of the budget, or over one-quarter of the budget 


if other support services are included.? | và av 
Table 4 contains comparatively few surprises. However, it indicates 


TABLE 4. Annualized ACPO costs by functional accounting unit 


E-—À a 0 n fp olas) de "HM A aj wan. 


t Percentage 
Division Cost (U.S.$) of total 
Administrative services 922,676 pE 
Planning and evaluation 73:353 13 
Sales and design 220,548 oi 
Printing press 1,418619 ps 
Record press 108,247 2.3 
Radio Stations 904,233 ‘ba 
Institutes 290,221 fe 
Cultural divisions 108,088 E 
Regional divisions 356,801 UA 
ther support services ... 2942539 S 
Toran 4:705:315 d 


Source: See texti 
i, 


1. The operating figures are obtained from ACPO’s actual operating budget and 
are iod un ich division using the accounting procedures of the ACPO 
Organization and the cconomic cost-accounting framcwork described above. 
Where costs could not be traced directly to a department, the best judgements of 
the planning and evaluation staff were used to assign them. 

2. For more on our methodology for computing these figures, see Tuckman and Nas, 


Op. cit., appendix. 
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two interesting aspects of ACPO’s operation. First, the organization 
spends comparatively little money on sales and design, preferring to 
make itself known primarily through its field staff. This may be a reflec- 
tion of the fact that after thirty years of operation, ACPO is well known 
among its constituents. It may also reflect the fact that comparatively 
few funds are left over for these types of operations because of the high 
cost of AGPO’s other activities, Second, if ACPO's field activities are 
adequately represented by the entries in the regional and institute cat- 
egories, then the ineluctable conclusion is that it is essentially a highly 


centralized organization. The regional staff takes a surprisingly small 
amount of ACPO’s total resources. 


Cost breakdown by educational input 


In this section, we provide co; 
the costs of each of the several 
education to rural campesinos. Th 
to those concerned with stud 


; » each of the entries in Table 5 
except the last one contains costs related solely to ACPO's educational 
operations.? 
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TABLE 5. ACPO costs by educational input category (U.S.$) 


—€————————————— ——HÓÓRÉRET ERR RR 


ati tment Total Percentage 

Category Does za cost of total : 
Radio 250,081 195,197 445,278 9.5 
Booklets 67,321 19,401 86,722 1.8 
Newspapers 357,241 38.578 395,819 84 
Study records 23,108 1,422 24,530 0.5 
Books 124,537 19,844 144,381 3-1 
Correspondence 57:579 1,119 58,698 1.2 
Institutes 491,639 36,050 527,689 11.2 
General activities 715,190 384,010 1,099,200 23.4 
Commercial operations 1,296,346 626,652 1,922,998 40.9 
ToTaL 3,383,042 1,322,273 4:705:315 190:0 


Source: See text, 
Sse 


a form of education which is inappropriately included in any other 
category because they enable the persons they train to obtain an edu- 
cation which such persons would otherwise not receive.* . 

The cost figures for each educational input category are derived as 
follows. The operating costs for cach department are allocated across 
educational input categories according to the percentage of time or effort 
Spent by each division in cach activity. Annualized capital costs are then 
computed with allocation of the proportion of space or the quantity of 
time employed by capital item in each activity. The operating and 
Capital costs of each educational input are then added across divisions to 
Arrive at a total dollar figure for cach category. 

. The training institutes command the largest share of total edu- 
cational costs (11 per cent of the total). This finding was obscured in the 
carlier budget formats because a substantial portion of ACPO’s printing 
and broadcasting activity is for commercial purposes. The training pro- 
gramme provides an important formal component which is often unrec- 
ognized because of ACPO’s reputation for spiritual training. While 
educational radio reaches many more people than the training institutes, 
the latter provide an important source of training to leaders in rural 
Colombia. The institutes occupy a fairly large plot of land, consist of 
several buildings, and hire a cadre of teachers. Thus, it is not surprising 
that they command a large, albeit not dominant, share of ACPO's 
total costs. 

ACPO’s radio facilities and its campesino newspaper each represent 
about 9 per cent of total educational costs. The significant decline in the 
Share of the tota] commanded by radio relative to the figures reported in 
earlier tables reflects the large proportion of total broadcast time which 


1. For more on the difficulties associated with classifying this hybrid type of cost, 
See Hitch and McKean, op. cit., p. 52-9. 
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ACPO devotes to commercial activities. As can be seen from the Table 5, 
the decision to sell commercial time has the effect of reducing the edu- 
cational components share of total costs. It should be noted that since 
the largest costs of radio transmission involve the capital equipment, and 
since this equipment would have to be purchased whether ACPO sold 
commercial time or not, the figures reported above are likely to under- 
state the true costs of operating an instructional radio facility of the type 
used by ACPO. Only in the case where an equivalent commercial oper- 
aüon would be mounted could one reasonably assume comparability 
of costs. 

Comparatively small amounts are Spent on the other media; 2 per 
cent for ACPO booklets, 3 per cent for the books, and less than 1 per 
cent for the study records. In part, this is a reflection of the low costs of 
production of these items. This is also due to the fairly low levels at which 
ACPO produces these items. In the case of the study records, we suspect 
that the relatively high price of a phonograph serves as a deterrent to the 
mass distribution of this item. 

The last two categories in Table 5 are not directly related to the 
educational inputs. These claim the largest amount of ACPO's resources. 
The first, general activities, includes those items which ACPO uses to 
provide support services activities. It is a joint produce of both the 
commercial and educational activities and includes costs related: to the 
labour union, food service, common buildings and land areas, vehicles, 
general services and administration, including accounting and auditing. 
The commercial activities category consists of all costs related to activities 
undertaken for profit-making purposes. Those include commercial time 
on the radio, commercial rental of the studios, advertising through the 
newspaper, and the non-educational operations of the printing press, and 
the record press. Given the problems implicit in distributing these costs, 
we believe it preferable to include them in a separate category. 


Breakdown by programme cost (educational output ) 


A programme cost analysis of ACPO is useful for several reasons. First, 
given its multi-output nature, ACPO is difficult to analyse in functional 
or educational w both which inputs 
ACPO produces and how well it produces them i 


i n order to understand 
; IN contrast to some other i; i 


output category, represents the first step in performin, 
analysis. 
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Our methodology for obtaining programme costs is relatively 
straightforward. The educational input costs reported in the last section 
are allocated by division to each programme output element using the 
percentages derived from a content analysis of educational inputs.! The 
output categories arc those identified by ACPO and an entry is included 
to take into account joint items that cannot be uniquely separated into 
any other output category. Table 6 presents our cost estimates in the 
form of an input-output matrix. The rows show the educational outputs 
and the bottom row corresponds to the dollar total in Table 5. The 
columns show the dollar value of the educational inputs used in the 
production of cach output and the last column shows the percentage of 
the total dollars commanded by each output. As in the case of the earlier 
tables, these are the annualized total costs of operating ACPO. 

While Table 6 does not suggest major differences in ACPO’s allo- 
cation of costs among the educational outputs, there are some. The 
largest percentage of total cost is claimed by the economy and work 
category; the smallest percentage is spent on arithmetic. The difference 
between the two categories is about 4 percentage points. 

Interestingly, only 36 per cent of ACPO’s total resources are allo- 
cated exclusively for educational purposes; about 41 per cent are allo- 
cated for commercial activity and the remaining 23 per cent for support. 
If the support component is allocated to the two other categories in 
proportion to their respective shares of total cost, the educational 
component rises to 47 per cent and the commercial component to 53 per 
cent.? These figures suggest that, although ACPO’s primary mission is to 
provide education to the rural campesino, over half of its resources are 
devoted to the production of commercial goods and services. In fact, 
ACPO is more of a business than an educational enterprise, at least 
Viewed from this perspective. 

In evaluating this finding it is important to understand that ACPO 
has been forced to seck out non-governmental revenue sources in order 
to survive. The dollar allocations reported in this chapter reflect an 
explicit policy decision to forgo some educational activities in favour of 
revenue raising, especially with respect to broadcast time. Had ACPO 
Chosen not to do this, however, it would almost certainly have had to 
Scale down its operations still further. 

We make no judgement as to whether this was a wise decision for 
ACPO. It seems likely that ACPO would rather have devoted all of its 
resources to education if its financial situation had allowed it to do so. 
The allocations noted in Table 6 reflect ACPO's realization that to 
Support a large operation without total government support it had to 
create independent revenue sources. Presumably, a substantially smaller 


1. See Tuckman and Nas, op. cit. 
2. The former represents slightly more than go per cent of the latter. 
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operation might be financed without the need for commercial activity. 
But this would clearly have an impact on the proportion of the rural 
campesinos reached.. 


Cost breakdown by components accounting 


Our final breakdown of ACPO costs is based on a common components 
classification scheme developed under the auspices of Unesco. This classi- 
fication scheme has four components. The ‘conception’ category includes 
those cost items which involve the formation and conceptualization of 
educational materials. The ‘production’ category includes all cost items 
concerned with the production of instruction and instructional materials. 
‘Transmission and distribution’ involves the cost of those activities associ- 
ated with fielding educational materials. Finally, the ‘reception’ category 
contains cost items directly associated with obtaining or utilizing the 
Instructional materials. A. 4 

While this taxonomy is quite useful in facilitating comparisons 
between instructional systems, it is less informative than several of the 
earlier breakdowns. Its major value is that it allows for a common 
comparison of instructional radio projects across countries. i 

Due to ACPO’s unique characteristics, particularly its commercial 
operations and multi-media approach, the Unesco classification scheme 
is somewhat difficult to utilize. To use this approach in a constructive 
manner, we have modified it somewhat. Our changes are reflected in 
Table ji 

Note that the planning a 

Nesco’s conception category, 
conceptualizing radio programmes, 
CPO project is already under way, 

ation of ongoing ACPO programmes are 


nd evaluation category corresponds to 
and includes time spent preparing and 
newspapers, booklets, etc. Since the 
all resources devoted to the evalu- 
included in this category. Both 


TABLE 7. ACPO costs by components categories 


ax Ir sem MU CP ME SX 


Percentage of 


Cost 
Category (in 1976 U.S.$) total 
M - 

; 4 6.6 
Planning and evaluation 3 11/698 24.2 
odium ph ; 30 

istribution REA i 
Commercial activities 1,922,998 ind 
€neral activities moe 23 
Tora. 1 in ern 


——MáÓ MM 


1. J. C. Eicher, op. cit., p. 17-21. 
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production and distribution correspond to the Unesco breakdown. The 
former involves all operations concerned with producing educational 
materials; the latter includes radio transmission equipment, vehicles used 
to transport educational materials and the persons who assist in using 
them, and all other capital goods and salaries related to bringing ACPO s 
message to the field. The reception category is excluded since serious 
problems exist in gathering information on this aspect of ACPO's 
programme. - 

The Unesco scheme is further modified by adding two additional 
categories. These are the commercial and general activities items which 
correspond to the last two items in Table 5. 


Alternative cost estimates jor ACPO 


Having completed the discussion of the six alternative accounting frame- 
works, we shall now find it useful to explore the possibility that our cost 
estimates do not accurately reflect the true cost of ACPO. In any study 
of this type there are several uncertainties which surround the choice of 
items for inclusion in the analysis. For example, the inventory records for 
an organization may fail to record all the capital items it uses, donated 
labour may be omitted from the accounting, or idiosyncratic flourishes 
may be added to a radio studio or training institute which are unrelated 


to the direct outputs of a project and unnecessary in producing a given 


set of outputs. Which items should be included in costing a project is a 
matter of judgement and reasonable men may disagree on the particular 
items to include or exclude in an analysis of this type. However, it seems 
clear that large omissions may understate the cost of providing instruction 
through a given medium and this can give rise to charges of bias.2 

In recognition of these judgemental differences, we shall establish a 
confidence interval or set of boundary points around our estimates. Using 
a set of plausible assumptions about ACPO, we report a low- and high- 


ei Meno within which the true annual operating costs arc likely 
to fall. 


I. This category is useful where the project actually distributes radios, provides 
community listening facilities, or otherwise subsidizes the costs incurred by the 
participants of the project. It 


; would be reasonable to include ACPO's subsidy 
to the newspaper and cartillas in this category and several other small items might 


also be added. However, ACPO's sale of radios would be excluded because this is a 
profit-making operation and because the majority of the campesinos own their 


own radios. Since reception is not the real issue i i 
í n evalua: p 
excluded this category from our analysis, naing ACPO, Wehay 


2. H. Levin and M. Carnoy, ‘Evaluation of Educational Media: Some Issues’, 
Instructional Sciences, 4, 1975, p. 385-406. 
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To provide a low-cost estimate of ACPO’s costs the following assump- 
tions are made: 

The entire field staff of ACPO is replaced by donated labour. This is 
equivalent to saying that all supervisors, leaders and dirigentes are 
unpaid. 

The overhead relating to items such as the chapel, the restaurants, and 
other support services are eliminated. 

All of the furniture utilized by ACPO is so old that it has already been 
fully depreciated. 

The cost of the 50-kW standby transmitter in Bogotá is eliminated 
from the capital cost estimate since it primarily serves for back-up 
purposes. 

7-5 per cent discount rate is used to annualize the estimate. 

A high-cost estimate is obtained by increasing our estimate of ACPO's 

total costs in the following fashion: 

An estimate is made of the initial set up costs of ACPO.* These are 
capitalized over a ten-year time horizon. 

The assumption is made that ACPO uses 10 per cent more manpower 
than is reported in its official field statistics. This might be the case, 
for example, if church personnel aid in ACPO field operations.? 

A dollar salary is assigned to the value of a dirigente's salary equal to the 
salary of a leader less the difference between a supervisor's and a 
leader's salary. This is applied to ACPO's estimate of the number 

f of dirigentes in the field.* 
Building costs are arbitrarily increase 
of donated space. 
he resulting cost estimate is discou ^ 
The alternative cost estimates obtained from each set of assumptions, 
together with the figure reported earlier in this chapter, are as fol- 
lows: the low-cost estimate of ACPO’s total annual operating cost 1s 
$4,002,000; the mid-range estimate, $4,756,000; and the high-cost 
estimate, $6,107,000. 


d by 10 per cent to reflect the value 


nted by a 15 per cent rate. 


1. The amount used in our estimate is $404,690. It T estimated by annualizing 
half the ine costs over a ten-year time horizon. 

2. It is pli ie know how much labour ACPO really uses for Md 
reasons. First, some of the radio schools which it lists as ongoing may actually 
have closed down, thus resulting in a lower manpower need. Second, some of its 
Past leaders who are no longer associated with the organization may still promote 
it. Third, in some parts of the country, community organizations may promote 
ACPO-related activities to their members. Thus, our choice of numbers is 
essenti i ; . 

3. The come es ae here is that ACPO maintains a constant dollar differ- 
ential in the salaries offered at its three field ranks. 

4- Short of launching a massive new space evaluation study, we are forced to proceed 


y assumption. 
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Conclusions 


The findings reported above illustrate the complementary nature of the 
various budgets and the differing insights that each one provides. In thc 
case of ACPO, the physical resources and functional inputs budgets 
suggest the substantial capital resources employed in the printing press 
and radio transmission operations. Subsequent analysis of the data in the 
context of the educational input and educational output frameworks 
revealed the large proportion of ACPO’s operation accounted for by its 
commercial activities. It seems clear that ACPO's major cost elements are 
related to its commercial rather than its educational activities, although 
it is equally clear that the former activities are necessary to allow ACPO 
to continue producing educational instruction on its current scale. 

The current balance between ACPO's educational and commercial 
activities is a fragile one and ACPO faces several important decisions 
regarding the scale of its operations in the future. The direction it will 
give to its commercial operations is crucial in determining the future 
scale at which it will operate. 

A second insight which emerges directly out of the functional 
accounting budget and which is also obvious from the educational input 
and educational output budgets is that ACPO’s administrative costs 
are fairly high, constituting between 20 and 25 per cent of the total. 
While this is partially a reflection of the services that ACPO provides 


its employees, such as the subsidized cafeteria and chapel facility, it also 
seems to indicate that ACPO can achieve 


some cost reductions in this 

area. 
Finally, from the educational out 
that ACPO does not allocate its funds equall 


that equal time w 
the extent to wh 
the next. 


ot known, however, is 
nge from one year to 
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Condensed version of two cost-analysis 

studies: the Kent Mathematics Project (KMP)' 
and the use of video tapes 

in a teaching laboratory at the University 

of Surrey (United Kingdom) 


Leslie Gilbert and Jenny Monaco 


Introduction 


A method for costing educational practice 


A handbook published by CET? entitled Costing Educational Practice by 

John Fielden and Philip Pearson of Peat, Marwick, Mitchell and 

Company, sets out a systematic method for costing educational practice. 

It illustrates how the method may be applied by means of case-studies 

Which analyse the costs of six recent technological innovations in the 

United Kingdom education and training systems. , s 
The method in question comprises five distinct stages involving: 

I. Identification of the practice to be costed. x ; 

TI. Decision on the approach to be adopted for the cost analysis. (This 
is achieved by categorization of the practice as one—or more—of 
five defined types.) 

Ir. Measurement and collection of data. 

IV. Data analysis and processing. 

V: Presentation of the cost analysis study. 


Purpose of the condensed version 


Out of i “studies. two are presented here. The purpose of this 
Nous version ik pueris fw each of the first four stages of the 
Cost-analysis method outlined in the handbook was followed in the cost 
analysis of the project. It is therefore presented in four SEGHODE using 
headings I-IV above. Readers may judge the fifth element—‘Presen- 
tation —by referring to the handbook itself. 


i i 8 
1. Council ional Technology, 3 Devonshire Street, London, 1978. 
2. The us oF eas cotens 3,700 square kilometres in the south-east of England. 


It comprises both rural and urban communities. 
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Kent Mathematics Project 


I. Identification of the practice to be costed 


1. Main aims of KMP 
To enable teachers to devise individualized mathematics courses for 
pupils aged between g and 16 in a mixed ability teaching situation and 


to encourage independent learning with the teacher adopting the role of 
classroom manager, consultant or adviser, 


course to be tailored to 


the ability and n his own level in each of 


the topics. 


D 1 g the state of the innovation at the 
time of the study and its time-scale) 


1962-66, experiments in one school; 1 
niques into about ten schools and the b 
allocations; 1970-73, consolidation un 


. H t 1 
and 27,000 pupils are using KMP. The i ini (LEA) 
intends to extend the scheme to the he locality (thus 
increasing the number of ) and plans to set up 
à new operating unit to ta nning of the system, 

4. Resources involved (expressed in their primary units) 
Staff time. The central KMP team responsible for design; iti 
t 1 esignin, t 
updating and testing new KMP materials comprises om e staff 
1. The CSE and GCE are public United 


| CS d Kingdom exami, ti 
pupils in their fifth year of Secondary school, i.e. at abont dde idi Per M by 
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who are qualified mathematics teachers, and ‘support’ staff who provide 

secretarial and other office services to the professional staff. 

(a) Professional . 
Initially there were no special allowances of time to develop KMP. 
In 1967, the teacher who had conceived the scheme was allowed two 
days per week. From 1970 onwards the professional staff allocation 
increased, as reflected in Table 1 which shows professional staff 
involvementin each year of the project in terms of full-time equivalent 
staff. It also shows the average number of days per week per person 
devoted to the project and illustrates a trend towards full-time 


involvement. 


Taste 1. Professional staff involvement 


a Eg AU. T pem rt Eve arcu 


Year Professional staff Avcrage days per weck 
(full-time equivalent) per member 
1967/68 0.4 2.0 
1968/69 0.4. 2.0 
1969/70 0.1 0.3 
1970/71 1.3 1.7 
1971/72 n 1.7 
1972/73 1.8 31 
1973/74. 3.8 3-2 
1974/75 42 4-2 
1975/76 52 43 


a É Ey ial TAD ee 


(b) Support 
Support staff time increased from 73 
nearly 200 hours per week in 1975/76. 


hours per week in 1968/69 to 
(see Table 2 for financial cost). 


Equipment and materials. KMP is such a large development project that 
there was not time in this study to itemize the equipment and materials 
9n which expenditure has been incurred, but information is available on 
the total amounts spent annually (sec Table 2). Initially, the expenditure 
Was incurred mainly on equipment and apparatus such as tape recorders, 
desk calculators and earphones, but gradually a greater proportion had to 

* Spent on printing and tape production. The material was printed 
Offset litho by the LEA, and was delivered to the schools by the 


’s transport. 


Accommodation, At first, the accommodation allocation was simply space fora 

table and a chair but as staff recruitment and stocks of materials increased, 
€ requirement grew to its present level of 88 square metres, divided 

between two existing teachers’ centres (see Table 2 for financial cost). 
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5. Qualitative effects of the change 


Qualitative effects of the change were broadly assessed at this stage (sec 
section IV below for details). 


6. Aims of the cost-analysis study 

The analyst approached the task as if he had been commissioned to 
provide information about the developmental and operating costs of 
KMP to LEA decision-makers confronted with the choice of whether or 
not to adopt the scheme. 


7. Basis for comparison 
It was not possible in this study accurately to com 
of the scheme with those of conventional teac 
dence that total teacher or student hours are s 
under KMP than with more traditional methods. 


II. Decision on the approach to be adopted 
for the cost analysis 


The approach adopted by the cost anal st was determine atur 
of the project. KMP is characterized re F5 nie, dung 


ITI. Measurement and collection of data 


I. Cost units 


he project; Table 2 gives the 
‘alt : Tesources which can be 

: TMs; the out-of-school hours which 
many teachers have given voluntarily to materials design, testing and 
In the time-scale of this study, and have 


2. Life of equipment and materials used in the Ke 
The life of the fully develo yaris d ep 
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3. Potential for transfer of the system to other LEAs and schools 

KMP is not peculiar to the needs of Kent, and the materials are to be 
published commercially and made generally available. Until then it is 
not possible to predict the probable level of take-up by other local edu- 
cation authorities or individual schools. 


TABLE 2. Summary of costs (£ at 1976/77 prices) 
i 


Year Professional Support Equipment and Accommo- Total 
staff staff supplies dation oe. 
1967/68 2,300 — 400 700 3,400 
1968/69 2,400 300 Es 1,400 4,100 
1969/70 600 400 — 1,400 2,400 
1970/71 7.900 1,000 14,700 1,400 25,000 
1971/72 10,200 2,000 15,000 2,800 30,000 
1972/73 10,900 6,000 15,000 2,800 34,700 
1973/74 22,100 8,100 15,000 4,900 50,100 
1974/75 24,700 11,400 15,000 6,200 57,300 
1975/76 30,100 15,100 15,000 6,200 66,400 
1976/77 31,000 13,700 15,000 6,200 65,900 
Torar 142,200 58,000 105,100 34,000 339.300 
Percentage 42 17 31 10 100 


IV. Data analysis and processing 


1. Financial costs at school level 
Every school using KMP needs a special ro p' arc 
Which the materials and equipment can be stored. However, individual 
School accommodation costs have not been included in this study. Ancil- 
lary assistance might have been desirable but has not so far been provided. 
_ The cost of equipping KMP workshops in April 1975 ranged from 
£220 per workshop for primary schools to £390 for secondary schools. 
his cost covered: audio equipment, tapes, worksheets and items for 
games such as pipe cleaners, dominoes and mirrors. The total financial 
Costs of equipment and supplies (see Table 2) are the actual amounts 
Spent adjusted to 1976/77 prices by reference to the general United 


Kingdom price index. ; i 

There is, in effect, no financial cost to the individual school operating 
the KMP system: the cost of setting up the workshops is at present borne 
by the LEA; the cost of maintaining them is paid for out of each school s 
normal ‘per capita’ allowance! and thus represents a substitution for 
Previous expenditure on traditional mathematics books and equipment. 


om or ‘workshop’ area in 


d Kingdom education authority to 


1. Alth i 
iex UE eive block allowances which can be used 


items of equipment. The 
and age ranges of the pupils enroll 
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2. Summary of financial costs incurred by the LEA 

Table 2 shows the financial costs of the project over the past ien years 
in 1976/77 prices. Increases in the average salaries of professional and 
support staff during previous years have been allowed for. Accommo- 
dation costs of the central team have been based on an imputed annual 
rental of £70 per square metre which was about the level in 1976 for 
office space outside London. , , 

No allowance has been made in the figures shown in Table 2 for 
in-service training or teacher meetings. This is because In-service training 
is considered a necessary local education authority activity and the K MP 
in-service training courses have only been partly devoted to KMP. The 
teacher meetings which have played a vital part in KMP development 
have also not been costed because they have been seen as part of the 
intended function of the teachers! centres already established in the LEA. 
Thus the only staff costs that have been included are the direct ones 
already described. 

The project has received some external funding but this has been 


ignored in calculating the costs. All resources have therefore been costed 
as if they were paid for by the LEA. 


3. Summary of quantifiable outcomes 


The outcomes of the project can be quantified in terms of the number 


of tasks produced, workshops provided and schools and pupils involved. 
Table 3 shows the growth of these over the last four years of the devel- 
opment for which data were available at the time of the study. 


Taste 3. Growth of the project 


Year S 


reg ag - Workshops "Tasks 
1972/73 63 14,000 120 513 
1973/74 65 15,000 194 586 
1974/75 65 19,000 211 747 
1975/76 71 23,000 


273 1,000 


4. Non quantifiable outcomes 
Some perceived educational outcomes of K 
inquiry sent to the participating schools, ar 
KMP helps non-specialist 
enhance their general knowledge 
KMP helps overcome pro 
teaching and encourages *self-dis 


MP, as revealed by a postal 
e: 
mathematics teachers 


to develop or 
of mathematics. 


nd by the choice of topics studied, better 
and in 
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small groups, and more willing to approach the teacher for advice and 
guidance when in difficulties. Additionally, poor readers can make prog- 
ress with the help of the audio-taped tasks. 


5. Steady state costs 
The steady state cost of an innovation expresses in one figure its average 
annual cost in the long term. 


Derivation of steady state cost of KMP. The steady state cost of KMP may 

be derived from: 

(a) The initial development cost which can be taken as the total figure 
from Table 2 (i.c. roughly £340,000). 

(b) The cost of the remaining workshops to be set up in Kent schools 
which can be estimated, on a pro rata basis, from the amount spent 
so far on equipment and supplies, as being in the region of £30,000. 

(c) The operating and continuing development cost which can be taken 
as that of the proposed central unit, estimated as being £30,000 per 
annum. " p 

(d) The cost of maintaining the workshops (i.c. replacing equipment and 
materials) which can probably be ignored for the purposes of this 
exercise. 


Calculation of steady state cost of KMP. Assuming that the project has a 
ten-year life, the annual steady state cost can now be calculated as 
follows: development period (one-tenth share), £34,000; remaining work- 
shops (one-tenth of £30,000), £3,000; operating costs, £30,000, or a total 
annual steady state cost of £67,000. 


nts an upper limit to the annual 


Comment. Thi bably represe 
um ME A es f royalty income from the future 


cost of KMP as it takes no account o m th à 
Publication of the materials (see Section IIT.3) or the contribution to be 


made by the proposed new unit to the general development of math- 
ematics in Kent. Both will serve to offset to some extent the central 
Operating costs. 


Of this total figure, about £60,000 represents marginal expenditure 


i i i he use of resources 
as the accommodation cost is a notional figure for t x 
already possessed by the LEA. About half of this £60,000 marginal o 
represents a contribution to spending which has already occurred an 


half represents a future commitment. 


6. Annual cost per pupil 
If the total of $67,000 is spread over for the 35; 


to become involved in the scheme, an annua 
pupil is obtained. 


ooo Kent children expected 
1 cost of just under £2 per 
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7. Cost implications to other LEAs who may use KMP 
The cost to other LEAs who might use KMP will depend on the prices 
charged for the published material and on the individual LEA’s or 
school’s arrangements for taking over the system. 

In Kent it costs about £430 at 1976/77 prices to equip a workshop 
for a secondary school where it will be used by about 100 pupils, or £4.3 
per pupil. If there are no further demands on central funds over an 
assumed life of ten years, then this implies an average cost to the edu- 
cation authority of around £0.5 per pupil per year. This, however, 
assumes that the workshops could be set up using commercially available 
material for roughly the same cost as that incurred in Kent where the 


LEA used their own production facilities, and is thus likely to be an 
underestimate. 


8. Conclusions : 

The main conclusions of this study are: 

The KMP system is now fully developed and in regular use by about 
27,000 schoolchildren. 

The main outcomes are of an educational nature and comprise a system 
which changes the role of the classroom teacher and provides an 
individual learning course for each pupil. 

The system has cost about £340,000 to develop, go per cent of which 
represents marginal expenditure. 

The steady state cost averaged over an assumed life of ten years is around 
£67,000 a year which may be reduced by royalties to be received 
from the sale of published material. 

The annual cost per pupil in the long term, taking Kent’s own pupils 
Into account, is likely to be of the order of £2. 

The cost to other LEAs could be significantly lower, but this will depend 
on the prices charged for the published material. 


Study of the use of video tapes 
in a teaching laboratory at the University of Surrey 


I. Identification of the project to be costed 


erent physiology experiments to be demon- 


ve groups of sixteen u P e 
students so that each demonstra 4 nder-graduat 


s r tion can be seen and heard without 
interruption from the four other demonstrations being given in the lab- 


oratory at the same time, and to overcome the probl 
of qualified demonstrators. Problem of short supply 
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2. Description of the project 

A video-tape system is used to give simultaneous practical demon- 
strations of five different experiments in the physiology laboratory of 
the Department of Human Biology. Each of the five video-taped 
experiments is relayed to eight small television monitor screens. (There 
are forty television monitors in all.) Each television monitor screen 
is equipped with two sets of headphones to accommodate two students. 
Therefore up to sixteen students can do one of the five available 
experiments in any one laboratory period. Prior to each period, a unit 
of material associated with the experiment to be carried out (written 
by a lecturer in the department) is distributed. At the beginning of 
each period, the thirty-minute video-taped demonstrations of the five 
experiments being offered are given to illustrate the experimental 
techniques involved and to provide relevant background theory. The 
Students then carry out the experiments themselves under super- 
vision and answer questions in space provided in the written units. 
These are marked by the staff and contribute to the overall course 


assessment. 


3- Development of the project (illustrating the state of the innovation at the 
time of the study and its time-scale) y 

1971, the need to demonstrate thirty different experiments per annum to 
àn increasing number of students (about 100), given limited space and a 
shortage of qualified demonstrators, creates severe problems; video-tape 
System conceived; 1972—75, installation and trials of eerie system 
1n à new laboratory; 1975, system fully operational; 1975-77, refinement 


of system. 
The development period is now complete and the system completely 


integrated into the undergraduate physiology courses. 

4- Resources involved (expressed in their primary units) . 

Staff time. Estimates e the time devoted by various categories of staff to 

the development of the project at the time of the study would form an 

important element of the subsequent cost analysis. Relevant information 

Collected at this stage is summarized below. , 

(a) Academic staff m One lecturer wrote separate units to accompany 
each of thirty different experiments. He also helped make the video 
tapes. Total time: 450 hours. —— l 

(b) Technical staff time. Three technicians designed, assembled, tested and 
installed the system. Total time: 510 man-days. One technician copied 

i in ime: -days. 
each video recording. Total time: 19 man-Cays. 1 

(c) Audio-visual aids staff time. Various specialists, including a producer, 
cameraman, engincers and graphic design artists, were involved in 
the production of the video tapes: total time: 66 man-hours for cach 
of 33 tapes — 2,718 hours (i.e. video tapes of thirty experiments, 


plus three remakes). 
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Equipment and materials. The system comprises eight 23-cm black-and- 
white television monitors, each with two sets of head-phones, on each of 
the five work-benches in the laboratory (i.e. a total of forty television 
monitors). The five experiments being offered are relayed from separate 
video-tape decks via a control unit. A written text accompanies cach 
video-taped experiment. A variety of small animals and laboratory instru- 
ments is required to enable the students themselves to perform the 
experiments demonstrated. 


Accommodation 


(a) A physiology laboratory located in a new building was completed 
just prior to the decision to develop the video-tape system, but has 
not been costed in this study. 

(b) Use of the television unit of the Audio-visual Aids Department for 
thirty-three days (i.e. one day per video tape). 


5- Qualitative effects of the change 


The video-tape system was introduced primarily to overcome the organ- 


izational and staff problems outlined in Section I (but see Section IV for 
some perceived educational benefits) 


6. Aims of the cost analysis 


To analyse the costs (and any cost savings) of developing and operating 


the video-tape system over a total assumed life of twelve years (scc 
Section IV). 


7. Basis for comparison 
The basis for comparison in this stud: 
to the introduction of the video 


Ip individual stu 


i €monstration properly and could be 
distracted by the occurrence of the four other ici mn in 
place in the laboratory at the same time. 

As the preceding paragraphs imply, 


these problems | i- 
ated by the introduction of the video r unm d n 


-tape system. 
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II. Decision on the approach to be adopted 
for the cost analysis 


The approach adopted by the cost analyst was determined by the nature 
of the video-tape innovation which is characterized by a complex mixture 
of resource and time effects. It also involves a significant change in the 
organizational running of the department and in the learning process, 
both of which make the scheme attractive although their outcome cannot 
be quantified. The scheme has to justify itself to a large extent in resource 
terms alone and in order to achieve an estimate of its overall net value 
it is necessary to combine the effects on the different resources (see 
Section IV). The GET handbook would categorize it as a ‘multi-resource, 
complex project (ic. Type 3 as exemplified in Chapter 4 of the 
handbook). 


III. Measurement and collection of data 


I. Cost units : ] 
Data on resource effects were all initially collected in terms of their 
primary units. However, as the previous sections have already indicated, 
Some of the resources involved in both the costs and outcomes of this 


Project are quantifiable and those which are measurable are diverse and 


measured in a variety of units. It was therefore recognized at this stage 
that a large degree of subjective judgement would need to be exercised 
In making an overall assessment of the project and this is reflected in the 


analysis outlined in Section IV. 


2. Life of equipment and materials used in the video-tape system 

he life of the entire system was assessed as being approximately twelve 
years and that of the educational material (i.c. the video tapes and 
written units) as being six years, thus allowing for two complete cycles 


of production during the twelve years. 


3- Potential for transfer of the system to other institutions 
ere is gai scope for the basic idea of the system to be adopted 


elsewhere but courses in other United Kingdom universities are claimed 
to be sufficiently different to make the adoption of the course — 
extremely unlikely. To date, there has been no more ice an bees 
exchange of isolated tapes (see Section IV for cost implications to other 


Institutions). 


IV. Data analysis and processing 
1. Summary of quantifiable costs (expressed in primary units) s 
iven ihe: ete already set out in Section I about staff time, 
equipment and accommodation, given also that each blank video tape 
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costs £10 and the reprographic costs of the unit texts are £1 per student, the 
costs of the system expressed in their primary units and spread over an 


assumed life of twelve years can be calculated and summarized as in 
Table r. 


"TABLE 1. Summary of costs 


ee ese 


s Technician Academic AVA Educational AVA 
Period eo time time staff time materials studio 
(man-days) (man-days) (man-days) (£) (days) 
1971-77 
urn 11,230 529 81 310 690 33 
(years 6-12) — 15 58 254 930 27 
Tora 11,230 544 139 564 1,620 60 


At the time of the cost-analysis study (1977) 
through its assumed life. The 1971-77 costs hav 
incurred and 1978-83 are estimates of future c 


the system was half-way 
€ therefore actually been 
osts. 


(expressed in primary units) 

ion I), the project has achieved 
“graduate demonstrators? prep- 
n eliminated; marking time has 
udent to about five minutes; the 
and any post-graduate students 


demonstrations are video-taped 


-year life of the 
tually obtained 
further growth 


i su - 
onstrators beyond two does not affect the results as, vibus pne pus 
staff assumed to be available, no associate lecturers would bene. 


3. Summary of quantifiable costs and outcomes combined 
Table 3 shows the results of the next 


Stage of the an: i 
resources, both for costs and outcomes, alysis. Here those 


which are measured in the same 
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TABLE 2. Summary of savings 


Saving in staff time 


by new system. Saving on Saving 
Period (man-hours) associate on 
= lecturers animals 
lemon- (£) (£) 
Lecturers perpe 
"Total to date 1,080 1,130 2,220 1,950 
Each future (o d 440 o 2,220 700 
year emonstrators 500 140 740 700 
assuming 24- available 470 270 o 700 
Total to o demonstrators 3,720 1,130 15,540 6,150 
years 12 I in years 4,080 1,970 6,660 6,150 
assuming 2+) 7-12 3,900 2,750 2,220 6,150 


the costs of the equipment and edu- 
cational materials and the benefits from the saving in associate lecturers 
and in expenditure on animals, all of which have pounds sterling as 
their primary units, are combined into one figure. Similarly, the academic 
Staff time spent developing the system is combined with the saving in 
time achieved from its operation. Other resources are kept separately for 


the time being. 


units have been compared. Thus 


4- Financial costs and savings 

The lower half of Table 3 reflects t 
Years, there will be one year when g 
strators available; two years when there are two available; and three 
years with one available. This assumption is obviously subject to error, 
but is the best estimate of the sort of distribution of the supply of 


demonstrators that might actually occur. é 1 
As an alternative, Table 4 illustrates the financial costs and savings 


Over the life of the project for situations where there are zcro and two 
demonstrators available for every year in the future life of the project. On 
the basis of this calculation, the analyst's best estimate shows a net gain 
of around £ 1,500 and an almost break-even situation in actual cash 
terms, 

All the figures for staff costs are based o 
Scales. The cost per day of the television stu 
Writing off the cost of the equipment over SIX years ani 
Studio is available for 250 days a year. 


he assumption that, in the next six 
there are no post-graduate demon- 


n 1976-77 wage and salary 
dio has been calculated by 
d assuming that the 


5- Non-quantifiable outcomes — 
In addition to achieving its aims, 
of the video-tape system are: 


some perceived educational outcomes 


cost and effectiveness 
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TABLE 4. Summary of results 

Assumption on Resources with Other resources Total 

years 7-12 £ as their expressed in in£ 

e primary unit £ units units 
No demonstrators! + 8,830 — 1,920 + 6,910 

à p 
Ret estimate — 50 + 1,580 + 1,530 
wo demonstrators — 4,490 + 38.140 — 1,350 

3 > 


1, A negative sign indicates a net cost and a positive one a net gain. 


That the equipment can be used for showing films made by com- 
mercial organizations or other institutions; or, in conjunction with a tele- 
vision camera, it can be used to show live experiments to larger audiences 


than would otherwise be possible. 

. . Although by no means without criticism, students are undoubtedly 
in favour ofthe new system and it seems reasonable to make the conserva- 
tive assumption that, educationally, the change-over leaves the depart- 


ment at least as well off as before. 


6. Discounting the cash flows 
In general, financial resources are worth more now than at some time in 


the future. The most common way of attempting to take account of this 
in project evaluation is to discount the series of cash flows to their value 
at the start of the project, using some notional discount rate. This has the 
effect of reducing future cash flows to a ‘present value’ such that if it 
were invested at the notional rate it would exactly equal the amount of 
the future cash flow after the appropriate period. This method has been 
used to amend the series of costs and savings which have money as their 
Primary unit using a normal United Kingdom discount rate of 10 per 
cent per annum. 

The results are shown in Tab: 
but the resources measured directly in mone 
counted to their value at year 1. 


le 5. This has the same format as Table 4 
tary units have been dis- 


TABLE 5. Summary of results when discounted 


ise aer Sn ae Sie 


Resources with 


£ as their Other resources To 
i $ " i tal 
Assumption on primary unit, (not discounted) TA 
Tras g discounted to expressed in ud 
their value at £ units 
year 1 
No demonstrators -+ 1,200 — 1,920 — 720 
est estimate — 2,810 -+ 1,580 — 1,230 
wo demonstrators — 4,810 + 3,140 — 1,670 
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The effects of discounting the cash flows are: firstly, that the project 
appears less attractive because most of the costs arise early in its life while 
most of the benefits accrue later; and, secondly, that the sensitivity of the 


overall result with respect to the supply of demonstrators is greatly 
reduced. 


7. Cost implications to other institutions which may wish to adopt the video-tape 
scheme 
The cost of adopting this scheme could be much greater to other insti- 
tutions than in the application studied here for the following reasons: 
Few other similar departments have such large numbers of under- 
graduates attending practical sessions. 


The development has so far cost the lecturer concerned about a year of 
his personal research time. However, in any future applications it 


may be necessary to relieve staff of their teaching duties or to recruit 
outside help. 


The department had access to a television 
standard and with spare capacity. An insti 
ties would find a similar project expensiv 


unit of high professional 
tution without these facili- 
€ to introduce. 


8. Conclusions 


£4,800 and a net gain of £1,200, 
The value in monetary 


Because the innovation has used resources which were relatively freely 
available in order to relieve the ha: 


| n orc rd-pressed resource of academic 
staff time, it is in real terms more c 


f real ore cost-effective than it appears from 
a simple calculation in financial term 


s, b i 
quantitatively » but this cannot be gauged 
In addition to the quantitative effec 
whole are certainly beneficial 
The decision to go ahead with the 
been the right one in the parti 
time concerned. 
There is scope for transfer of the idea 
but similar development elsewhe 
in the system studied. 


ts there are other changes which on the 


development therefore seems to have 
cular institution and at the particular 


rather than the detailed material, 
re might be more expensive that 
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Socio-economic analysis of two systems 
of educational television in Brazil 
in the states of Maranháo and Ceara’ 


J. B. Oliveira and F. Orivel 


Introduction 


For an economist, the outstanding feature of an educational system centred 
On the use of television is that fixed costs are higher than in systems 
employing traditional methods. 

Is this extra cost counterbalanced by gains elsewhere? In theory, 
there are two main potential ‘benefits’. The first is lower labour costs 
since the teacher is no longer the only purveyor of knowledge. He is, in 
fact, less important than the television set and therefore, in theory, needs 
to be less qualified than before and hence less well paid. - 

The other advantage expected is related to the quality of teaching. 
The combination of two media (teacher and television), often sup- 
plemented by a third (written materials), should produce significantly 
better educational standards. I i Te 

These two benefits, which the economist 1s seeking to identify, fa a 
necessarily reflect the objectives of most known experiments. m - 
ground to each project reveals that decision-making probea ere "e 
complex, that certain individuals have played a dominant role and " 
the underlying arguments vary greatly according to the particular 
Situation. : 4 

A glance at the past suggests that enthusiasm for the ie ia, 
Strong in the 1960s, has been tending to subside since the m eel 

t is significant that, in the 1960s, three specialist groups o due 
*ven— dominated the planning and implementation of these e is m 
experiments: educationists attracted by the possibilities of the new me s 
manufacturers wanting to sell their new products, and specialists E e 
Use of the equipment together with ‘politicians’ or final decision-ma c 
Only recently did economists begin to take an interest in new s u- 
cational technologies, when decision-makers became somew at confus- 
edly aware that the cost-effectiveness of their experiments was s as 
advantageous as expected and wanted more precise accounts founded on 


Observed data rather than on forecasts. Í EM. 
It is not always self-evident that education by television is more 
awn from a 1976 study made by the authors 


1. The information on Maranhao is dr ; 
amison. 


in conjunction with E. Arena and D. J 
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cost-effective than the traditional approach, and in addition there is a 
world-wide trend to hold back the growth of resources allocated to 
education. The world average today is 5.1 per cent of GNP. The elasticity 
of public expenditure on education, 2 between 1960 and 1965 and 1.5 
between 1965 and 1970, dropped to 1 between 1970 and 1974.1 It is 
thus unlikely that the 5 per cent average will go up much, though country- 
to-country variations might be slightly reduced. Brazil, which is well 
below the world average, will perhaps tend to draw closer. 

The challenge thus facing those in charge of education is to do better 
with resources that are going to stay the same. 

Recourse to technologies based on industrially manufactured media, 
that is, technologies with a falling cost structure, seems a priori to offer 
a possible solution. In the technology of providing goods and services, 
education is a curious exception to the general rule in that labour plays a 
dominant role and capital a very small one. Indeed, it may be wondered 
whether the tendency for capital costs to decrease will ever apply to the 
education sector. At all events, there are two reasons why education has 
so far been unaffected by industrial-type technologies. First, its production 
costs are not charged to the ultimate authority, i.e. employers, but are 
usually borne by tax-payers and families. Tax-payers have been led to 


believe in the *higher good’ and families to believe that human capital 
is profitable whatever the cost. Second 
cationists tend to pla. 


in so doing, to defend their jobs) 


qualified schoolteachers, the hi 
lower teacher costs and better e 


; ducation. 
This report shows that thes 


€ goals have been only partially attained. 
I Background 


General economic situation in Brazil 


In the last fifteen years, Brazil’s gross national product (GNP) 

at a very high average rate (6.9 per cent) 

foreign and public capital investment. 
Like a few other developing countries, 


k c c such as Singapore, the 
Republic of Korea and Mexico, Brazil spent this period eat aes 


has grown 
» largely due to the volume of 


1. See J. C. Eicher and F. Orivel, L' Allocation. des Ressources à P Éducation dans le 
Monde, 1960-1974, Paris, Unesco, 1979. 
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a modern and sophisticated industrial economy and is likely to become, 
within the next few decades, a major economic power with a particularly 
well-developed public sector. The country also possesses large stocks of 
natural resources, some of which are of great strategic importance. 

„The net inflow of foreign capital is still regarded as a vital means for 
solving short- and long-term difficulties as regards the balance of payments 
and for financing the investments on which future growth depends. 

The public authorities are taking more and more economic initiatives 
to counterbalance the influence of the multinational corporations and 
make up for the weakness of private initiative at home. The State is 
concentrating its expenditure on infrastructures or social measures and 
on stimulating investments (by measures to guarantee demand and by 
long-term loans). There is, however, not much room for manoeuvre, 
partly because the government cannot call upon foreign suppliers as 
much as it would like and partly because it has to contend with severe 
international competition in the economic activities it is seeking to 
develop. At the same time there are pressing needs within Brazil that 
must also be taken into consideration. 


Taste 1. Evolution of overall GNP and per capita GNP 


ee Ae a a 


Per capita GNP 


russ Bi: Daan in USS 
ro 41,776 92,343,000 452 
i 49,338 94,927,378 519 
n 58,466 97:585,548 599 
wis 77,236 100,317,900 769 
1975 106,666 107,000,000 1,010 
1976 116,052 109,996,000 1,099 


t. Estimated by applying a growth rate of 2.8 per cent to the 1970 census. 
Source: Estatisticas da Educação Nacional, MEC/S6/SEEC, World Bank. 


The country is faced with two formidable problems: the permanent 


disequilibrium in the balance of payments anda very high rate of inflation. 
hese are due not only to inadequacies in the economic policy being 
followed but also to the nature and forms of the capital employed and 
to an unbalanced economic structure. Furthermore, the Brazilian econ- 
Omy’s growing dependence on foreign capital subm H 
interna] economic policy to the dictates of multinational companies. 
These difüculties lead to frequent and considerable changes in the 
exchange rate, the cruzeiro having lost three-quarters of its value in 
relation to the U.S. dollar between 1969 and 1978. In the two years 
from 1976 to 1978, the general price index exactly doubled. AEN 
To complete this brief review of Brazil's economic situation, it must 
be stressed that the average per capita GNP, over $1,000 in 1976, 
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"TABLE 2. Rate of inflation in Brazil 


Rate of inflation Conversion factor to 


res (%) Setara obtain 1978 cruzeiros 
1969 22.3 13 7-70 

1970 19.8 15 6.46 

1971 20.4 19 5.26 

1972 17.0 22 444 

1973 15.1 26 3.78 

1974 28.7 30 3.28 

1975 27-7 39 2.56 

1976 49.0 50 2.00 

1977 41.0 71 1.41 

1978 — 100 1.00 

"TABLE 3. Evolution of cruzeiro in relation to U.S. dollar 

heus us smile. dui Mr, VELLE. we PBN E a 
Year and month Soa per Year and month Oosa per 
1969 4.076 1974 July 6.845 
1970 4-92 1975 January 7.51 

1971 5-60 1975 July 8.23 

1973 6.18 1976 December 11.76 

1974 January 6.30 1978 February 16.45 


a —— cŘħĂ—— 


conceals the fact that incomes are extremely unequally distributed since 


the top 20 per cent of the population account for 60 per cent of total 
incomes and the bottom 20 per cent no more than 1.5 per cent. 


Economic situation in the state of Maranhão 


Maranhão is one of the twenty- 
Brazil. Its area, 
of Germany, 
3 million inh 
kilometre. 
Maranhão is situated between th, 
(the celebrated Sertào) 


two states of the Federative Republic of 
a, much the same as that of Italy or the Federal Republic 
is a little over 300,000 square kilometres but, with only 
abitants, the population density is a mere 10 per square 


e dry regions of the north-east 


and the immense humid plain of t} . 
Its capital, Sào Lufs, borders the Atlantic, plain of the Amazon. 


only a few degrees south of 
the equator. 

It is one of the poorest states of Brazil. 
to agriculture and go mostly for local consu 
are rice, manioc, millet and beans; su 
industrially. Stock raising and fishing 

As in Brazil as a whole, the pop 


Its main resources are related 
mption. The main food crops 
Sar-cane and oil palms are grown 
are essentially for local needs. 

ulation of Maranhão is expanding 
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rapidly, by about 2.8 per cent a year. In 1940 there were only 1.2 million 
inhabitants but in 1975 over 3 million. The result is a very young popu- 
lation and therefore relatively few workers. 

The most recent census (1970) classified the working population as 
follows: primary sector, 762,900 or 78.4 per cent; secondary sector, 49,184. 
or 5 per cent; tertiary sector, 161,076 or 16.6 per cent, totalling 973,160. 

These figures indicate that less than a third (32.5 per cent) of 
Maranháo's population is active and that more than three-quarters 
depend on subsistence farming. 

It is difficult to provide accurate GNP figures for Maranhão. 
In 1969, official documents put the per capita GNP at $78.4 and it is 
very unlikely to have exceeded $200, or a mere one-fifth of the national 
average in 1978. 

As with Brazil in general, income is very unequally distributed. 
Here again there exist no statistics, but a few indicators will serve. In 
November 1976, the minimum legal wage was 544 cruzeiros a month or, 
at the official rate of exchange, $46, but a wide variety of sources suggest 
that many wage earners receive far less. Municipal primary teachers, for 
example, are paid less than half of this sum and an idea of their pur- 
chasing power can be gathered from the fact that a basic food such as 
beans then cost 20 cruzeiros a kilo, a meal in a restaurant 50 and a pair 
of sandals 100. At the other end of the scale, the wealthy classes enjoy 
roughly the same income as their counterparts in Western countries 
and a distinctly greater purchasing power, 


since the cost of services is 
low and fringe benefits are more common (chauffeur-driven car, servants, 
etc.). 


The public authorities (state and communes) administer small 
budgets which make it impossible to provide social services (such as 
he existence of a wealthy class explains 


education) of a high standard. T. 2 
the growth of a network of fee-paying private schools and the still very 


inadequate coverage of public education. 


Economic situation in the state of Ceara 


In 1977, Ceara had 5.3 million inhabitants in an area of 146,817 kilo- 
Metres (36 inhabitants per square kilometre). The population is young 
t a year. The chief economic resources are 


and growing at over 2 per cen : n 
agricultural—cattle-raising, beans, cotton—and industrial development 
is still on a small scale, almost entirely concentrated on light industries 


(textiles, foodstuffs), with a small chemical sector. 

The towns and cities have grown very quickly over the last twenty 
years. Fortaleza, the capital now has over 1 million inhabitants while 
four other cities have more than 100,000 and seven between 50,000 


and 100,000. 


Population movements o 
the villages to small towns, 


ccur on a large scale, in several stages, from 
from small towns to medium-sized towns, 
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from the latter to the capital, and from Fortaleza towards the more 
developed states of Brazil. 

The working population is small, numbering only 1.4 million out 
of 5.3 million (26.4 per cent) in 1974: 60 per cent work in agriculture, 
13 per cent in industry and 27 per cent in services. Services alone account 
for 57 per cent of the added value, mainly at the expense of agriculture 
(only 30 per cent) and a little at the expense of industry (12 per cent). 

The 1977 per capita GNP can be estimated at about $250 a year, or a 
quarter of Brazil’s national average. Even though Ceara has developed 
quite quickly in recent years it is still a poor state with many problems of 
infrastructure, public services and employment to solve. On the whole, 


the economic conditions in Ceará are fairly similar to those observed in 
Maranháo. 


General organization of education in Brazil 


There are three levels of education in Brazil. Basic 
the first grau, lasts eight years (first to eighth years), followed by three years 
of secondary education (second grau) and higher education. 

In theory, responsibility for education is shared between the com- 
munes, whose job is to run the first four years of basic schooling, the states, 
which look after the next four years and the three or four years of sec- 


ondary education, and the federal government, which deals with the 
universities. 


schooling, known as 


fifth year onwards. 

ral government. These 
habitants and the efforts 
€ proportion to per capita 
mpact because there are 


isis is applied to a varyin 1 : 
: g extent in the states, 
and it is fair to say that the network of schools in all states with a per 


^ c e national average is still rud; te 
ticularly in the rural areas of ge 1s still rudimentary, pa! 


central and northern Brazil, which retain 
€ rapid growth of towns. 


of these regions i cert Ta " t 
rate from one year to the next gions is the very high drop-ou 


- The rate, in fact, i ; 
first years of primary education th m UM ae T 


at onl i 
reach the secondary level. my about ro per cent of pupils 
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Another feature of the rural regions—also true for southern Brazil—is 
their inability to attract the qualified teachers they need. The fact is 
that, from the fifth year onwards, teachers are subject-teachers and must, 
in theory, hold a university-level qualification. These people are very 
difficult to keep in rural areas since, in a country as enormous as Brazil, 
they are all but completely cut off. 

The result is that the few schools which do teach the fifth to eighth 
years usually have low standards, and this produces an educational 
pyramid with a broad base and very narrow top. 


Taste 4. Educational pyramid in Brazil 


es, 


Enrolments: 

Level Class Year first year = 1,000 
University 1974 ay 
Secondary education 3 1973 43 

4 1972 87 

1 1971 107 
Basic schooling 8 1970 dex 

7 1969 I15 

6 1968 133 

5 1967 165 

4 1966 245 

3 1965 318 

Pe 1964. 449 

2 1963 1,000 


Source: Estatisticas da Educação Nacional 1971-73, MECISEEC, p. 29- 


chances a pupil starting school in 1963 
levels of the system. Those chances are a 
re is still a long way to go before the 
enrolment rate for all eight years 


This pyramid shows what 
eo of acceding to the different 
ittle better today although the 
rcoretically compulsory 100 per cent 
OF basi ion i ined. ae: 

sic education is attained ils in basic schools, distributed 


In 1 e 19,286,611 pup 
as bad irr à of Hn basic school enrolments are repeaters. The 
first year alone accounts for 30 per cent of the pupils whereas, with a 
Constant enrolment rate throughout the eight years, it should be only 
12.5 per cent, Though enrolment is almost total in the first year, it drops 
to 60 per cent in the second year, to 50 per cent in the third and less 
than 20 per cent in the eighth year, the general average being under 
45 per cent, or 62 per cent for the first four years and 26 per cent for 
: By 1 di hool, state schools take 57 per cent of pupils, municipal 
Schools peee venh paiva schools 12 per cent and federal schools under 
I per cent. As for standards, the private schools, attended by children of 
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TABLE 5. Children at school in 1974 


uev E a O | S ee e À 


Year New entrants Repeaters Total 
8 821,674 49,328 871,002 
7 1,045,590 98,598 1,144,189 
6 1,279,451 154,686 1,434,137 
5 1,609,825 218,066 1,827,891 
4 1,899,416 204,440 2,103,856 
3 2,266,421 266,649 2,533,070 
2 2,620,923 523,697 3,144,020 
I 4,290,788 1,411,282 5,702,070 
Year of enrolment unknown 468,374. 57,402 525,776 
Toran 16,302,462 2,984,149 19,286,611 


the rich, have the highest reputation, followed by the state schools. The 
municipal schools are regarded as very mediocre. 

The shortcomings of the formal education system have led the 
Brazilian authorities to organize non-formal remedial systems known as 
‘suppletivo’: (a) the Mobral is an adult literacy campaign which, in à 
few years, has involved nearly 10 million people; (b) a very large number 
of institutions exist to give a second chance to those unable to attend 
School at the normal age: continuous training for primary teachers, 
agricultural training, technical and vocational training, diplomas (madu- 
reza) equivalent to the first and second levels. These institutions come 
under either the federal government or the states. 


It should be pointed out that most educational courses using radio 
and television come into this category, though the school television 
projects of Maranhão and Ceara are part of the formal system. 

. . To conclude this summary of the general organization of education 
in Brazil, it should be noted that the school year begins on 15 March and 
ends at Christmas, thus coinciding with the civil year and avoiding many 
headaches for the statistician. Furthermore, the school day is, in fact, 
only a half-day of 4 hours; with 5 days a week of school (i.e. 20 hours) 
and I 80 days a year (720 hours), Brazilian schools function for 25 per cent 
less time than, for example, French ones. This system has two important 
consequences. In the first place, classrooms can be used for two separate 


classes, one in the morning and the other in the afternoon, a possibility 
which economists would recogni: 


ze as a particularly efficient allocation O' 
resources. Secondly, the teach 4 


š é ers, who are occupied for four hours 
every morning, have the time t 


y o take up a second job in the afternoons, 
and it appears that many of them do so. 
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Education in the state of Maranhão 


The education system of Maranhão, like that of Ceará, reflects in a 
concentrated form the shortcomings and omissions of the Brazilian system 
1n general. 

Table 6 sets out the growth in basic school enrolments (first to eighth 
years) from 1971 to 1976. The schools are grouped according to who 
finances them: the federal government, the states, the communes or 
families (private schools). The communes play a very important part, 
with just over half the total school population. Their schools, mainly for 
the first four years, are of a very low standard, with minimal resources. 

The state of Maranhão finances about a third of total enrolments. 
Its schools usually cover the full eight-year course but, of 205,000 pupils in 
their charge, 168,300 are in the first four classes and only 36,700 in the 
fifth to eighth years. 

Inasmuch as the figures for private and federal schools concern 
almost exclusively pupils in the fifth to eighth years, there is no doubt 
that the state of Maranhão has enormous difficulty in meeting its legal 
Obligation to provide schooling for the fifth to eighth years. The fact is 
that about 350,000 children should be studying at this level but the state 
Schools actually cater for only 36,000, or about 10 per cent. 


TABLE 6. State of Maranhão: enrolments in basic education, 
by financing authority 


Mas O Gti) lt anam aob Adede dati 


Enrolments 
= Enrolment 


Year 7-14 year - 
population! Federal — State Commune es 
schools ^ schools schools schoo! 


sous 682,970 12 107,52 241,380 56,019 409,046 59.9 
1972 698.662 Feed iMt 260,963 64,633 454144 65.0 
1973 — 715,162 4278 140,017; 269,173 79422 487,490 68.2 
1974 732,295 4,198 160,219 280,403 81,123 525943 71.8 
1975! 750,227 4,846 182,649 293.410 82,284 — 563,719 — 751 
1976 768,823 5.495 205,079 306417 984525 601,516 78.2 


1. Estimated, ; j 
2. The actual rates are rather lower because total enrolments include children under 7 (about 5 per 


8 cent) and over 14 (about 15 per cent). 


Between 1971 and 1976, the average enrolment rate rose from 60 per 
Cent to 78 per cent but, allowing for the fact that 5 per cent of pupils 


are under 7 and 15 per cent over 14; the true average rate in 1976 for 
the 7-14 age group was only about 60 per cent. i 

he quality of education in the state of Maranhao reflects, in an 
even more exaggerated fashion, the already-mentioned pyramid. Taking 
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Taste 7. State of Maranhão: fifth to eighth year enrolments in 1976* 


Fifth Sixth Seventh Eighth Total 

No. % No. % No % No % No. % 
FMTV? 4:448 34.3 3:413. 33-9 2,992 36.8 2,169 39.2 13,022 35-4 
Other schools 8,509 65.7 6,664 66.1 5,142 63.2 3,404 60.8 23,719 64.6 
ToTaAL 12,957 100 10,077 100 8,134 100 5,573 100 36,741 100 


1. No data is available on 1976 enrolments in private schools. In 1973, however, they accounted 
for about 60 per cent of total enrolments for the fifth to eighth years and there is no evidence 
to suggest that this proportion fell between 1973 and 1976. 

2. The Fundação Maranhense de Televisão Educativa (The Maranhão Foundation for Educational 
Television), the system examined in this report. 


the cohort starting school in 1962, of 100 pupils aged 7 in the first year 
thirty-seven entered the second year, ten the fifth year, seven secondary 
education and two university (in 1974) (it is assumed that there would be 
about the same number of repeaters as in the age groups immediately 
before). The situation has slightly improved with time. An estimated 
25 per cent of pupils (including those in private schools) now enter the 
fifth year, but it must not be forgotten that there is a wide gap between 
Sao Luis, the capital, and the rest of the state, which is still in much the 
same situation as the age group already referred to. 

rs This is probably due, among other things, to the very low average 
living standards of the population—some of the lowest in South 
America—the fact that there is a long way to go to school, poor teaching; 
inadequately trained teachers with low salaries, not even a basic minimum 


of teaching materials and, in general, serious administrative shortcomings 
in regard to finance, management and staffing. 


Education in the state of Ceará 


Ceara, of course, displays similar features, with a very large number of 
pupils dropping out from one year to the next, 


he apparent enrolment rate, as Table 8 indicates. is improving 
(from 54 per cent in 1970 to 72 per cent in 1975) for the eight years of basic 
education. In point of fact, however, nearly 200,000 of the 785,000 enrol- 
ments in 1975 were over 14 or under 7 years old with the result that the 
actual number of children in the 7-14 age group attending school was 
only 585,000 or 55 per cent. This rate, moreover, is simply an average 
and the pyramid effect means that it is quite a lot higher in the first 
years and much lower towards the last years; that is, the years covered by 
the school television system with which we are concerned. There are als 
notable differences between those living in towns (apparent enrolment 
rate over go per cent) and country dwellers (under 50 per cent). 
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Taste 8. State of Ceara: enrolment rates in basic and secondary schools 
ee 


Basic schools Secondary schools 
Year Enrolments 7-14 year Enrolment Enrolments 15-19 year Enrolment 
population rate population rate 
1970 511,930 943,319 543 27,962 475:545 59 
1971 550,388 968,533 56.8 31,154 488,750 6.4 
1972 653,566 995,839 65.6 36,838 ^ 502,530 73 
1973 705,612 1,024,062 69.0 38,354 516,772 T4 
1974 776,402 1,053,235 73-7 45:467 531,494 8.6 
1975 784,900 1,083,398 72.4 52,895 546,715 9-7 


Source: SEES/MEC, 1976. 
SS ee Te un] 


the least well off, provide for 52 per cent of pupils; 
hools being slightly better off but 


hools, accessible only to the more 


Municipal schools, 
state schools for 26 per cent, these sc 
mainly in the towns; and the private sc 


for up to 1983 which show 


a slightly improved enrolment rate but at a pace which will not make it 


are few and what teachers there are, very underqualified. The school 
television projects have been launched there as a large-scale answer to 
this problem and the purpose of this report is, in fact, to determine how 
far this decision is providing a satisfactory solution. 


U Two systems of education by television 


It is Particularly interesting to compare the systems of school television 
m Maranhão and Ceará as both are essentially aimed at the second part 
of basic education, that is, at pupils from the fifth to eighth year. 
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The Maranhão system emerges as an independent, centralized 
scheme in which the medium of television is an integral part of a new 
approach to teaching, focused on development. 

The Ceara project, on the other hand, is part of the present education 
system. It is decentralized and the television programmes are designed to 
assist or support teachers who volunteer to take part. In Maranhão, the 
infrastructures limit television coverage to the capital and its suburbs, 
but in Ceará it extends to rural areas too. 


School television in Maranháo 


Goals 

When the Maranhão authorities took the decision, towards the end of 
the 1960s, to set up a system of school television, their goal was to meet the 
educational needs of the State. The first step was to develop the public 
education system by providing an educational service at the level of the 
second half of basic schooling for children who did not have access to 
that schooling. 

The main target audience is the children of poor people in the 
suburbs of the capital who cannot afford private school fees. These 
underfed youngsters, with little interest in learning and unable to see 
the point in education but anxious to receive practical instruction, are 
well aware of the reality within which they will have to make their way: 

This situation also explains the second goal, which is to renew 


curricula. and teaching methods in order to provide the State with the 
skilled labour necessary for development. 


Institutional structure 
The Fundação Maranhense de 
in 1969 to organize the new sy 
directly under Maranhio’s 


Televisão Educativa (FMTVE) set uP 
3 stem, is an independent institution coming 
c ecretary of State for i is its 
president. It has the powers of a school system tom d is 
responsible for providing the last four years (fifth to eighth) of basic 
d The schools and classes come under the sole authority ° 
: e : VE which ope . ones when necessary and appoints the 
eaching staff. The course is free but the other (privat hools do not 
have access to school television. ice ne mue 


Development of the system 
In early 1969, thirty-five fifth- 


five pupils in each, were tau with an average end 


circuit television. By 1979 ? 
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concentrated in the São Luís region. The most distant school in 1978 
was sixty kilometres away. Further expansion, and hence more schooling 
for rural areas, depends on broader television coverage. The FMTVE is 


aiming for 25,000 pupils in 1981 and 35,000 in 1985. 


TABLE 9. FMTVE: New classes and enrolments by year, 1969-78 
Oene S T O eee 


Year Reber Number Tii Sixth Seventh Bighth =a 
schools classes year year year year 
1969 15 35 1,255 = = ad 1,255 
1970 9! 152 4,516 1,735* — — 6.251 
Bn 9 199 — $512 —— 49! 1712, vd a 94415 
ae 9 265 3,691 3,433 3,859 1696 12,619 
1973 10 300 2,936 3:443 3,131 3,401 12,911 
1974 10 272 3,614 2,723 3,099 2,688 12,124 
1975 10 286 4,192 3,160 2,681 2,446 12,479 
1976 18 315 4,448 3,413 2,992 2,169 13,022 
1977 14 315 nd nd nd nd 13,407 
1978 15 318 nd nd nd nd 15,004 


1. Schools were re-grouped in 1970. Each school consists of a number of classes of which most but 


not necessarily all are in the same place. . 
2. This figure is higher than 1969 fifth-year pupil numbers because of the relatively numerous cases 
of direct access when the system came into operation. 


The organizati i 
zation of teaching E oT 
The FMTVE’s lee > to teaching starts from the principle that the 


Pupil is an active agent of the educational process, education being 


regarded in its broadest sense as an action conducive to changes in the 
f all aspects of his personality. 


Pupil’s attitude and the development o l 

hese principles are put into practice through: problem-based learning, 
a Syllabus broken down into small pluri-disciplinary units; abolition of 
the class system—work is not based on the class but on small groups of 
SIX to seven pupils within the class. Teaching is based on group dynamics, 
arning and teaching within the group and mutual instruction. The 
teachers, known as ‘counsellors’, play a key role in stimulating the small 
8toups that make up the class; a process of continuous assessment by 


regular tests to gauge what has been understood and assimilated so that 
Support teaching may be immediately arranged whenever necessary; 
a Very large measure of individual or group initiative. 

i Teaching proceeds in four = "m iem 

s subject is i ced by the television programme. 

ject r oaa Á aimed at developing the sense of 


?- Individual or group exploration 
analysis and criticism. x 
3. An individual reply or general discussion to complete the process of 
assimilati 
ation. k and final summary. 


^ Assessment of individual or group wor 
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ses function , 
b n ren with a television broadcast of about twenty minutes, 
which usually ends with a question, or ‘challenge’, which has to be 
considered and dealt with by pupils, working in groups of six or seven in 
classes averaging forty-five. The chief task of the ‘counsellor’ is to encourage 
his pupils to carry out the activities suggested by each programme. The 
pupils can refer to written materials prepared and distributed by the 
centre, and they are provided with the materials needed for experiments 
or various other class activities. Once a month, each group elects a 
spokesman and a leader, who are in charge of internal discipline and have 
to see that the various stages of the teaching process are carried out. 
Individual or group findings are presented and discussed by the spokesmen 
and the leaders may question pupils in other groups. The counsellors 
usually intervene very little and it is by no means uncommon to sec 
classes functioning normally when the counsellor is not there. 

Class work, however, is only part of the educational process. There 
are many other activities, such as clubs (literature, the arts, games, 
politics) and all kinds of practical handicrafts. 

Saturdays are often set aside for general revision, meetings between 
the counsellor and pupils, or big inter-school get-togethers or celebrations. 
Assessment 
Marking and assessment is based on three factors: (a) the actual work 


done by pupils in each subject (15 per cent of the overall mark); (b) indi- 


vidual practical exercises (25 per cent) ; (c) general tests produced by the 
team that plan the courses ( 


n 60 per cent of the monthly mark in each 
subject). Apart from showing the pupils intellectual ability, these tests 


are designed to reveal his ability to think and analyse, his sense O 
synthesis, his interest in the subject, and 


so forth. 
Teaching staff 
This approach to education has given the teaching staff a new role and 
function. 


The classes are run by ‘counsellors’. These people are non-specialist 
educators whose work is backed up b 


EE : .by educational advisers or ‘supe! 
visors’, the latter being teachers specializing in the basic subjects taught. 
Unlike ordinary schools, there is no 


« EE. headmaster or director but one OF 
two ‘supervisors’ to see that classes functio: 
At the beginning of each 


: ae is 
year, a fortnight’s training-course ! 
arranged for ‘counsellors’. All c. ý 3 ; 
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Organization of production and broadcasting 

Teams of specialists in curriculum development, the production of tele- 
vision programmes and written materials prepare what is needed for 
the system at the Sào Luís centre. The relationship between these teams 
has varied over the years but the views of educationists have, on the 
whole, always prevailed. The production division is in charge of pro- 
grammes from the initial idea to final evaluation but, for a number of 
reasons, the task of production itself has tended to receive more attention 
than inquiry, analysis and self-criticism. 

Until 1974, the lack of tapes left the teams with the enormous task 
of reproducing all the broadcasts each year. These difficulties have now 
been overcome and many programmes are stored for rebroadcasting the 
following year, with the result that production has been stabilized at 
Its 1976 level (see Table 10). At first, most of the programmes simply 
placed a teacher in front of the camera. Today more and more film 
excerpts, illustrative photographs or drawings and brief printed messages 
are included. Each programme must focus on a specific objective. 


TABLE 10. Number of television programmes produced? 


acas oe oe oul me e cane ee ee 
1975 


1969 1970 1971 1972 1973 1974 
Pr Ograj 
mmes produced 
2nd broadcast J63 1,159 D714 1901 2,063 2,210 1,229 
Togrammes ri 
ecorded ji T Bd geo aay 


Or later use = us 


1. The average length of a programme is twenty minutes. 


Source: FMTVE/Curriculum co-ordination. 


fifth- and eighth-year pupils in 


T ir t the 
he broadcasts are directed a pipid T 


€ morning and at the sixth- and — 
* same classrooms being used twice a day. cu 

The centre also brace written materials for the pupils in the form 
Of six textbooks of about 200 pages for each level. These textbooks are 


revised annuall h du s 

FMTVE hab its own production and iru ns cra It e 

Set up two studi : setvative offices and offices for the educationa 
tudios, administrative c c 

staff installed in xnakeshift premises. It has its own transmitter (2 Kw), 


and produces on two inches and one inch (Ampex equipment). It eed 

Pies a maintenance unit and workshops for je ed vi ge ao [o 

the ce is also a print shop for the written 
ntre hools. There 1s print i 

Materials ae goers: office that provides illustrations for those 

Materials as well as contributing to the television programmes. Lastly, 


ani istributi i documents. In 1975, the 

E he distribution of its own 

Production ventte ehiploged 280 persons, or 33 per cent of the total 
MTVE staff. 


O 
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Feedback and control 

FMTVE keeps in touch with the supervisors through the centre’s edu- 
cational co-ordination service, which arranges monthly meetings. It is 
not at all uncommon for the educational director to join them. 

The supervisors are the link between the classroom ‘counsellors’ and 
the centre. They meet the counsellors regularly each week to discuss the 
past week’s work and plans for the next. The counsellors have a great 
deal to do in as much as they must mark what has been taught and report 
on the problems of individual pupils, lesson plans and test results. This 
information is written down on special forms, picked up by the supervisors 
and collected for statistical purposes by the education co-ordination service. 


Educational television in the state of Ceará 


Objectives 


When the Ceará authorities decided, in the early 1970s, to set up @ 
system of educational television, the most important objective they 
assigned to it was to improve the quality of education in the second half 
of basic schooling and to facilitate the opening of new schools within the 
state. The next target was to serve other sectors, especially adult education 


and courses for the backward and, lastly, to provide general information 
and foster cultural activity. 


Institutional framework 


The decision to create the educational television of Ceará (TVE) was 
taken in 1973 by the state secretariat for education. A new institution, the 
Fundacào Educacional do Estado do Ceará (FUNEDUCE), which also 
aa the state university, was set up. Within the FUNEDUCE, 
po s B Sud under the authority of the secretary of state for edu- 
pale a eem caa by an executive director with the assistance of four 

chnical directors. Its budget is incorporated in that of FUNEDUCE and 


apart from increases to com i i 
pensate for inflation, h i nstant. 
The task of TVE is to prod Fpp is 


and to train teachers and ed: 
schools or their staff. This is 


The development of the system 

Under these conditions the system dey 
EON ei i eloped very quickly, the only 
limitation being the extent pe eye "d 
network. ; ent of the coverage provided by the televisio” 
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. _ TVE was established in 1973 and started broadcasting for fifth- and 
sixth-year classes in 1974. Table 11 shows how the system has expanded. 
The first group completed the course in 1977. The geographical coverage 
is given in Table 12; the average number of pupils per class has fallen 
from 39 in 1974 to 29.5 in 1978 because the system now includes the 


smaller classes to be found in rural areas. 


TABLE 11. State of Ceara. Development of school television 


EE oa. 

i us 5 2 E g = E S = 

G r Zu oy Ss ri 
1974 8 30 106 2,536 1,603 — — 45139 
1975 29 92 286 5831 20633  n281 — 9,700 
1976 — g4 107 389 $917 4539 1945 95a 1223 
977 80 ,72 9,251 1492 18,392 
e T eu es Pa 3,500 2,600 19,800 


1978! 45 nil 672 10,000 3,700 


TABLE 12. State of Ceará: category and location of schools 
with television classes, 1977 


Location 


Cate, 
E Capital Elsewhere "Total 
State. Schools 102 81 - we 
; unicipal schools 152 93 E 
rivate schools = T í 
"edera] nil 5 
ONEC: ee ia II II 
Torar 254 201 455 


1- CNEC refers to the National Campaign for Community Education. 


Organization D | ; 
S in Yos redeo take place either in the morning or in the 
xs Thoon. The school day starts with a television seria o thiya 
5 lowed by thirty minutes of general discussion led by the — 
aim being to use concrete situations to develop the verbal fluency an 
iitical spiri i is the various subjects are studied. Each 
Esson ~- oF papt AN a TE on the television, followed 
Y work on a number of back-up activities chosen. by the non ip rom 
“'8Bestions in the textbook. There are many activities red ae Ue md 
even some for children to undertake on their own. At the end, eac! 
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lesson is summed up by a pupil. A vital feature of the system is that the 
teacher is not provided with a guide or any special instructions. 

Mondays are rather different. Work begins with a set of questions 
designed in such a way that the ground covered in each subject may be 
tested twice a month. The tests are televised and corrected at once, and 
the rest of the day is set aside for physical education, the arts and other 
activities. . 

The system encourages but does not organize out-of-school activities 


and clubs. What these do and how they are run is entirely up to the 
teacher. 


Assessment 

Pupils are assessed in four ways: 

The television tests, whose results are noted down by the teacher each 
week. 

Class exercises and activities, marked by the teacher. 

A mark-sheet with various headings such as attention, interest, creative- 
„ness, participation and discipline, which the teacher has to fill in. 

Individual and group marks awarded by the pupils themselves; they must 
give themselves a mark for regular attendance, behaviour, atti- 
tude, etc. see if their classmates agree, and then hand the result to 
the teacher. 

Each month an overall assessment is made on the basis of these four 

evaluations and this decides whether a pupil will move up to the next 


class, The Ceara TVE is only told the class average, individual results 
being kept by the school. 


Teaching staff 


Apart from the educational advisers, the Ceará TVE does not have its 
own body of teachers and uses those already working in the schools. In 
theory, however, subject teachers are replaced by a single class teacher, 2 
requirement that raises awkward timetable problems. 

Away from the capital, teachers must have completed secondary 
education or the equivalent and undergone a year of teacher training- 
In Fortaleza they are graduates of higher education, most of them in the 


arts or social sciences. Joining the school television system has no effect on 
salaries, which are fixed by the school, municipality or state 

Before new television classes come into operation their teachers 
gather in Fortaleza, the capital, for a three-week course. This training 


deals with the actual syllabus but is m ink s he 
niques and how the system works, ainly focused on leadership tec 


Educational advisers employed by T : a 
* y TVE rec b cilia 
and visit classes once a week, Their job is'to back tp din bis dienen 


information on how Pupils are progressing and serve as a link between 
schools, local education authorities and TVE, 
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apnea of production and broadcasting 
igure 1 outlines the rather compl i i 
U plex but well-integrated o; i 
dictns and production. i a 
he initial programming, which is the res ibili i 
: à ponsibility of four special- 
vl for each basic field of study—takes the form of a three four 
poge ist of specifications which is then passed on to four independent 
bu s (printed documents, television broadcasts by subject, serials and 
: s). An educational control unit makes sure that what they produce is 
properly integrated. 
is The serials are televised each day and last twenty to thirty minutes 
ds each level. They are arranged in series—four per year—and each 
meris series focuses on one or two central themes. For fifth- and sixth- 
p classes they tend to be dramatic in approach whereas interviews, 
rnalistic reports and documentaries are more usual for the seventh 


and eighth years. 
The television timetable is arranged beforehand and communicated 
d sixth years are broadcast 


a A the schools. Programmes for the fifth anı c 
Sie e from 7 to 11 a.m. and those for the seventh and eighth 
fdcey M I p.m. to 5 p.m. The schools are responsible for servicing their 
he ers; the programmes, live or recorded, are used for four years. 
written materials, in the form of booklets, printed in Fortaleza, are 


s à 
old to the schools who have to collect them from the production centre. 
The Ceará TVE has its headquarters in a specially constructed air- 
situated in a residential 


Condes M 
Onditioned building of 1,200 square metres, 
tal. It contains two small professional 


hree Ampex video-tape recorders 
Jl as work-rooms, committee rooms, 
The ro-Kw transmitter serves a radius 
ay stations, not yet 


f the state's 141 towns. 


W : 
oe and laboratories. 
Shee km round Fortaleza but 

plete, at present covers only 45 © 


Feedback and control 
i Ost of the feedback is provided by the supervisors, who havea monthly 
d dj E with those in charge of production to examine all technical and 
.ucational problems. Detailed summaries of these meetings are dis- 
Tibuted to all staff, Information on teaching results is kept for statistical 
Purposes only. Apart from this, pupils and teachers may write directly to 
€ production centre and, from time to time, producers visit classes to 


M 
atch the programmes. 
The two systems: strong points and difficulties 
mmon to make comparison possible. 
n and have their own production 
own approaches to teaching 
classes and courses, in pro- 


Th i 
a systems have enough in co 
ivi „are based mainly on televisio: d 

ision and technical staff; both have their 


w MAP t 
hich are reflected in the organization of 
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Official 
curricula 


List of specifications: 
themes 
aims 
subjects 
contexts 
choice of medium 


Television 
Programmes 
by subject 


Written 
materials 


Control 
and revision 


Television 
Production 


Printing 
of written 
materials 


Broadcasting 


Fic. 1. State of Ceará: organization chart for Production of school television 
programmes. 
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gramme i i 
Gap rhe in methods of educational assessment. Both have been 
rom, or parallel to, the existi i 
a > » or p e existing educationa 
a e with hostility from the system. = dass 
diu d, on systems, however, have different aims and are organized 
erent lines. In Ceará, school television keeps pace with the 


expansi B ] s 
lo p i, E enrolments and is mainly designed to compensate for the 
ard of general education. Although information at our disposal 
rmed from existing classes 


rempl A poene to distinguish newly fo 

Fortilbza, i scheme, the latter are at present more numerous. In 

lagena > ; nere the quality of teachers is not a problem, the relatively 
mber of television classes associated with the system can only, 


in £ B 
act, be defended by the project's need to reach a critical size in order 
dible. Moreover, the fact that a single 


teachers, even though 


prob : bes 
lems. Away from the capital, the situation 
ly it adopts television, though i 
ma; A " gh in 
ny towns the existence of a small body of 
it is in rural areas that 


cre 
feu ENTIRE, Generally speaking, however, ! 
ion is most likely to help extend the provision of schooling and 


eee therefore, is much less strong an 
Thay of the infrastructure. — 

due to ere is no doubt that the superi 

to its highly decentralized structure; 


wi A 
Spe t was introduced. The school televisi 
€ running of schools; the key figure is the supervisor, who has both 


educar; 
Cational and administrative duties. In the long run, however, the 
i hat schools retain their 


iect to the authority of the 


ority of the Ceará TVE is largely 
which explains the speed with 
on service has nothing to do 


ll be transferred to the 
ducation department. Such 


by the € 
s of liaison between the 


e problem 


ducation sub-system with a 
Its main problems 
set-up, the need to rationalize 
f written materials, and wider 
Jf is logical and united by a 
ntionally innovative. 


Centralized 1S «i e iue am 
are inter and somewhat over-staffed admums , 
televisio, nal: a ponderous 
elevision production and t 

n coverage. But the str 


il 
9sophy of teaching that is cl 
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III The two school television systems: costs 


The school television systems in Maranhão and Ceará use rather different 
accounting techniques, and this has made it necessary to adapt our 
methods of estimating costs to the particular features of each. 

Another point is that this analysis deals with historical costs in that 
they go back to the initial year of each project. For Maranhão, forecasts 
up to 1985, reflecting the system’s development plan, have also been used. 


Lastly, costs are expressed in 1978 cruzeiros by means of the deflator 
for Brazilian currency mentioned in Section I, page 19o. 


Costs of school television in the state of Maranháo 


Expenditure 1969-76 
Table 13 sets out annual FMTVE ex 
Capital expenditure can be classified by 


current expenditure, which could only 
the year 1976. 


penditure from 1969 to 1976. 
function more accurately than 
be broken down in detail for 


TABLE 13. FMTVE: total expenditure 1969-76 
(in thousands of 1978 cruzeiros) 


2969 Ie 187x 1972 1973 1974 1975 1976 

Construction of 

buildings and 

transmitter 18,972 
Studio and 973 4"9 1916 i514 sgg gagy agro (5750 

broadcasting 

equipment 8,838 6,08, a 
Furniture for 7 4 134 1,350 772 928 386 Li 

schools and 

centre 692 1,078 6 
Television sets 786 — 2,228 p Li 284 NE on 442 ds 
locua So te 9 — 9 86 e go 9o 

TOTAL 29,200 14,086 10,550 12,912 


8 
i $612 6,176 3,240 505 
Operating costs 5,160 10,432 10,8 

v , 279? 19:49 24550 35,40 33,040 45,394 


J course, have to be adjusted too. The 
basic data presented here enable the financial i ca jations 
in the development plan to be deduced. Mus: peP 


Case-studies 
209 


_Tables 14-17 deal with cost projections for, respectively, adminis- 
tration, production, broadcasting and reception and utilization. In the 
first two cases it is assumed that real annual costs will remain constant 
up to 1985 with no expenditure on new buildings or new studio equipment 
in particular; only vehicles will be replaced. 


TABLE 14. FMTVE costs projections 1977-85: administration 
(in thousands of 1978 cruzeiros) 


ems 


Annual cost 


Category 

Salaries 6,146 

Salary-related contributions 2,238 

Supplies and services 2,184 

Vehicles 100 

Equipment 130 
10,798 


~ s TOTAL 


TABLE 15. FMTVE cost projections 1977-85: production 
(in thousands of 1978 cruzeiros) 


Annual costs 


intenai 
Maintenance — Total 


Staff and services 
Production of curricula 3,340 20 3,360 
roduction of television programmes 5,826 304 Sage 
reparation of written materials 1,868 40 1,890 
11,034 364 11,398 


"CU o ANN NN M 


977-85: broadcasting 


Taste 16. FMTVE cost projections 1 
eiros) 


(in thousands of 1978 cruz 


Eos Buildings Equipment Vehicles — Stafi Operation Total 
1977 8,000 3,540 300 790 gia 12,942 
1978 7, TUO 2,460 150 1,000 452 11,222 
1979 8,760 2,900 180 1,612 732 14,184 
1980 e hi 160 1,612 732 2,504, 
198: — 1,0005 160 1,612 732 3,504 
1982 ms ES 160 1,612 132 2,504 
1983 = = 160 1,612 732 2,504 
1984 -- =e 160 1,612 732 2,504 
1985 == = 160 1,612 732 2,504 

is Buildings needed for extending the television network. 

+ Aft i T year. - me 

3. Pee t dvo Te onal employes for surveillance and servicing once the extension is 

on eec supplies and services in proportion to present real costs. 


H Operad Jectricity, : 
eration covers the cost oro r emitter will be partially renewed in 1981. 


5- On the assumption that the present tran 
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Broadcasting costs (Table 16) include large sums for Tereny 

television coverage by means of new relay transmitters in three ee 
stages (1977, 1978, 7979) ee the replacement of the present trans 
i ars of service. 
" Ec ve het on reception and utilization (Table 17) are pora 
on FMTVE assumptions concerning the number of new classes in e 
area covered by the network extension and on the forecast number d 
pupils. School-building plans for 1977-79 will leave certain classroom: 


"TABLE 17. FMTVE cost projections 1977-85: reception and utilization 
(in thousands of 1978 cruzeiros) 


——————————————— E 


EROR Supplies? 
á E 

s i % * 3 E € « 

25 E § M E 225 B ri 

sig e 6 3 a ifik È 
1977 15,326 — 9472 264 4,375 326 240 2,376 770 ps 
1978 — 17,520 9,092 256 5,001 306 302 2,716 880 36,073 
1979 21,246 14,326 416 6,063 498 402 3,2904 1,066 47:3 a 
1980 27,438  — 168 7832 — 402 4254 1,378 EE 
1981 33,000 — 168 9:37  — 402 5,126 1,660 dier 
1982 3750744 — 168 10,581 — 402 5,748 1,862 55; 2 
1983 40,688 — 168 11,612 — 402 6,308 2,042 Dna 
1984 40,688 — 168 11,612 — 402 6,308 2,042 61 doin 
1985 40,668  — 168 11,612 — 402 6,308 2,042 61,22 


i. H " iros. 
1. The average monthly salary of teachers, including social charges, amounts to about 3,000 cruzeir: 


n 000 X 12 
The annual cost per pupil is therefore 2:999 X 12 
2 


thus V (number of pupils) x 860 x 1.32, 1.32 being the coefficient, based on past experience, t° 

allow for absence, maternity leave; refresher courses and so forth. 
Total 1976 floor area in 

- @) pm of Pp =; p = 0.82 m? per pupil. At 2,000 cruzeiros per square 

metre, the cost per pupil is 1 640 cruzeiros; 

pupil x number of new pupils concerned by 
in 1979. 

3. (a) Calculated at 4,000 cruzeiros per clas: 

depreciation rate has been calculated for all 420 classrooms. 

4. These costs include supplies, salaries znd salary-related 

and electricity. They amount to 324 cruzeiros per pupil per year. 


s r t 
5. (a) New receivers: 4,400 cruzeiros x number of new classrooms; (b) replacements: 20 per ce?! 
of total value of television sets in stock each year. 


6. (a) Printing costs of written materials: each Pupil receives cight documents a year, 


— 860 cruzeiros. The total cost !5 


(b) total cost of new classrooms: price of m? p 
the extension: 9,472 in 1977, 9,092 in 1978, 14,3? 


sroom at time of building; (b) after 1980, a 10 per cent 


CPC " er 
contributions, invoiced services, wat 


the total annual 
cost of which is 2,274, 


| 
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empty until the beginning of the 1980s; that is, until the new fifth-year 
pupils have reached the eighth year. 


Cost functions 

The cost functions of the system will be presented on the assumption that 
total costs can be classified in two categories, fixed costs and variable 
costs, the latter depending on the number of pupils (JV) in the system. 
Hence the cost function is: 


TC(N)s = Fa + VNas 


where TC(JV) is the total annual operating cost of the system when it 
serves JV pupils, F the fixed cost and V the additional cost of enrolling 
à new pupil. f : 
As both F and V include capital as well as operating costs, the capital 
Costs have to be expressed as annual instalments so that they can be then 
added to operating costs. The annual capital costs so calculated may be 
regarded as equal to the sum the system would have to pay if B ur 
ment were bought on hire purchase instead of in cash at time ki d e jen 
These costs expressed as annual payments depend on t duca 
ables: the initial purchase price, the forecast life of the equipmen E: 
the economic rate or rate of interest. For purposes of comparison, the 
annual payments resulting from the application of on ike rates 
(0 per cent, 7.5 per cent, 15 per cent) have been worke m ^ EA 
Table 18 breaks down the variable costs (V) per pupil per year. 


, l Ha 
this table, A gives annual operating costs, B the annual Asch “ae 
at each of the three rates of interest, and C gives the total vari 


Or each rate of interest. 


Taste 18. FMTVE: variable costs per pupil per year 
(in 1978 cruzeiros) 


A. Operating costs 1586 

Others baf 

ther Operating costs 176 

Titten materials 58 

ther supplies ELI 
1; 

Torar, 94 


Rate of interest 


B. Annual cost of capital 


0% 7-576 1576 

Purn; 6 8 10 
Furniture (life: 10 years) le 14 18 
lac vision sets (5 years) 54 140 250 
eb see 7 ^s E 


Toran 


C. Total variable costs (A+B) 
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Tables 19 and 20 show fixed costs for 1976 and 1980 respectively. 
In 1980, broadcasting costs have changed because the system has now 
been extended. 


TABLE 19. FMTVE: Total fixed costs per year 
(on the basis of facilities available in 1976) 
(in thousands of 1978 cruzeiros) 
—Ó—r — CHA ———— — 
A. Operating costs 


Production! 11,398 
Broadcasting 690 
Administration 10,568 
TOTAL 22,656 
B. Annual cost of capital? 0% 7-596 1596 
Buildings (life: 30 years) 232 590 1,062 
Equipment (10 years) 1,002 1,458 1,996 
Vehicles (5 years) 48 118 142 
mE EN, 
TorAL 1,282 2,166 3,200 
C. Total fixed costs per year (A+-B) 23,938 24,822 25,856 


5 value of vehicles: 476,000 cruzeiros, 


TABLE 20. FMTVE: Total fixed costs for 1980 
(in thousands of 1978 cruzeiros) 


A. Operating costs 


Production 8 
Broadcasting 1502 
Administration md 

TOTAL 2 Te o 
B. Annual cost of capital o, : 9 
Buildings (life: 30 years) - 028 7-5% p 
Equipment (10 years) 1,892 E 9,770 
Vehicles (5 years) : 48 E 142 
C. Total fixed costs per year 27,278 25208 732918 

> 


> es to 3,66 
development plan, the system will be c 


years’ time. Using the 1980 cost function, the average cost at that time 
(applying the 7.5 per cent interest Tate) 
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TABLE 21. FMTVE: cost per pupil per year (in 1978 cruzeiros) 


Number of 1976} 1980} 
pupils (JN) TC(N) = 24,922 TC(N) = 29,792 
+ 1,4856. + 972 

Sun 6,820 7,846 

15,000 3,510 3,852 

edm 2,848 3,054 

35,000 2,566 Eni 

45,000 2,408 agaa 


1. Capital costs are expressed as annual payments at 7.5 per cent interest. 


Cost of the Ceará project 


The Ceará TVE has a separate budget within FUNEDUCE. This 
budget has, on several occasions, proved inadequate, though TVE has 
managed to cover the deficit thanks to various donations, particularly 
from the social fund of Brazil’s National Savings Bank. 

TVE, as already stated, had two central tasks: to broadcast courses 
for the last four years of basic schooling (about eight hours a day except 
for the week-end) and to provide various other programmes such as adult 
education courses (the Joa da Silva programme giving the equivalent of 
the first four years of school, produced at Rio de Janeiro), a television 


magazine (produced locally), Ceará government communiqués (also pro- 
d films from other source—in 


duced locally), relayed sports an 
A programmes 
al, nearly ae [ege day or as much as the school broadcasts. 
Many of those at TVE work on both these tasks, so only part of 


their time should be charged to school television. 


Ceará TVE: evolution of the bud 

x [get E 
In 1973, the year de the school courses began, a total of 9 million 
cruzeiros was spent: 2.4 million on the land and building, 5.7 million on 


electronic equipment and furniture and 900,000 on the project staff. 
TVE is managed by FUNEDUGE, but not free of charge. The 
FUNEDUCE budget for general administration is, in fact, equivalent 


to the TVE budget and should be apportioned between TVE and its 
Other activities, n these charges are calculated in proportion to the direct 


Costs of the various FUNEDUCE activities, the direct budget of TVE 


Should be increased by one-seventh. 


Resource allocation within TVE 
Fuge TVE organization chart 
o5 the production division, 
Per cent to maintenance @ 
Production division spends an estim: 
television and one-third on other programmes, 


at go per cent of staff costs relate 
4o per cent to the educational division, 
nd ro per cent to administration. 'The 
ated two-thirds of its time on school 
the educational division 


shows th 
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"TABLE 22. Ceara TVE: evolution of fixed expenditure 
(total budget less supervisors and printing) 
(in thousands of constant 1978 cruzeiros) 


1973 1974 — 1975 — 1976 1977 — 1978 
Capital Land 15477 
Building 7,558 
Broadcasting equipment 11,850 393 13 136 d; = 
Studios and cameras 9,100 373 13 4,000 — e 
Furniture, etc. 1,2900 — — — — — 
TOTAL 31,275 766 26 4,136 a 
Operating costs 3:350 11,240 12,650 10,706 14,273 13,418 
Share of general FUNEDUCE 
budget charged to TVE — 1,680 1,682 1,624 1,687 1,800 


TOTAL 34,625 13,686 14,358 16,466 15,967 15,218 


is fully employed with school broadcasts (50 per cent preparation of tele- 
vision programmes, 50 per cent production of workbooks), and the other 
two divisions, maintenance and administration, each devote half their time 
to school television, the former being attached to the production division 
and the latter existing as a separate service, All management costs from 
the general FUNEDUCE budget have been regarded as administrative 
costs. This cost pattern gives the resource allocation shown in Table 23- 


TABLE 23: Ceará TVE: allocation of resources to school 
and other programmes 


(SP=school programmes; OP=other programmes) 


Resources 
Buildings Production o, [ 2/3 SP 
30% [1 /3 OP 
Furniture Educational division 4096 100% SP ee television 
e 50% workbooks 
Staff Maintenance 20% | 50% SP 
Operating costs Admini . = H 
other than salaries) Administration 10% BE OP 
o 
Electronic equipment (studio, transmitter) { 60% PS 
40% OP 
School programmes Other programmes 
Production 2[3 of 30% — 290, y. 
Educational Division 100% of re 1/3 of 30% — 1096 
Maintenance 0% of 20% — 1997 PE /, 
Administration 50% of 20% =10% 50% of 20% — 1076 


0% 6 «9, 
50% of 10% — 5% 50% of 1095 = 5% 
TorAL 
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TABLE 24. Ceará ' VE: administrative, production and broadcasting costs 
(in thousands of 1978 cruzeiros) 


_ " 1973 1974 1975 1976 1977 1978 
Administrative costs 2,336 
Production costs oe ie n EN et y 
dsimision programmes 2,436 6,403 7,109 6,376 8,161 7741 
reparation of workbooks 756 2,334 2,616 2,227 2,941 2,773 
" Torar 3192 8,737 9725 8,609 11102 10,514 
roadcasting costs 7 734 735 743 744 1,244 


with reception. Reception or util- 


TVE is not directly concerned 
d in the analysis of cost functions. 


ization costs will therefore be examine 


Cost functions 
The fixed costs (FC), i.e. costs that do not depend on the number of 
Pupils taught, include those incurred in devising and broadcasting tele- 
vision programmes, producing the workbooks, and administrative costs. 
The variable costs include reception, the printing of written materials, 
the remuneration of educational advisers and class teachers, and the 


Maintenance and depreciation of classrooms. t 
Although, unlike Maranhão, the majority of variable costs other 
than the salaries of educational advisers are not met by the centre (the 
workbooks, for instance, are sold) they are none the less costs and are 
required for purposes of comparison. Unfortunately, it was not possible 
to visit every school in the system to find out the costs borne by them. 
lassroom costs, like teachers’ salaries, probably vary from one school to 
another but by how much we cannot say- 


Reception and teacher salaries. The centre makes various recommendations 
when endeavouring to persuade a school to join the system. In 1977, for 
example, it recommended a television set at 3,600 cruzeiros including 
aerial and suggested that teachers should be paid 1,440 cruzeiros a 
month which, with social contributions (115 cruzeiros) and materials 
200 cruzeiros a month) comes to 21,960 cruzeiros per class per year 

7.5 per cent). As the 


(including depreciation on the television set at r ; 
rage variable cost 1s 750 cruzeiros, 


Average ec .: I yë 
class size is 29.3 pupils, the 2 
a figure that must be increased by 40 Pet cent to obtain the 1978 cost 
IN 1978 cruzeiros: 1,050 cruzeiros. 

we saw in the section on 


Buildings . As for classroom depreciation, 
E, for which we have precise figures, that because each classroom 


is used by two different classes, one in the morning and the other in the 
a per pupil are needed which, at 


aj 

afternoon, only 0.82 m? of floor are es T 
H 1 VÁ 

2000 cruzeiros per square metre, gives à cost of 1,040 cruzeiros per 
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pupil. Spread over thirty years at 7.5 per cent this gives an annual 
depreciation cost per pupil of 140 1978 cruzeiros. 


Educational advisers. The centre’s forty-six educational advisers, paid 
at 2,500 cruzeiros per month over thirteen months, cost (including social 
contributions) 1.8 million cruzeiros in 1978 or go cruzeiros per pupil. 


Printing costs. The workbooks are replaced each year because certain pages 
are filled in by the pupil. Those in charge of the system say that this 
avoids the problem of exercise books. Designed at the TVE centre, the 
workbooks are printed at a state-owned printers and invoiced at cost price. 
They are then sold at cost price to the schools that have signed an 
agreement associating them with TVE, and the schools are free to give 
or sell them to pupils. Certain schools do not always pay but no special 
measures are taken against them. Hence there are several possibilities 
as to who pays in the end. 

In each of the system’s first two years, eleven workbooks of thirty 
to forty pages were produced for the fifth- and sixth-year classes; this then 
fell to eight workbooks of seventy to eighty pages for the seventh and 
eighth years. In 1977 the former were sold at 8 cruzeiros and the latter 
at 10 cruzeiros. In addition, each pupil receives two booklets (8 cruzeiros) 
for religious education, and educational advisers and teachers are supplied 
with special handbooks for which no charge is made. Distribution is on 
pragmatic lines. In most cases schools outside the capital take advantage 
of a trip to Fortaleza to collect the documents. The variable cost of these 
documents is 110 cruzeiros. 

Thus, in 1978, the total variable cost per pupil is: 

Vis = 1,050 (reception and teachers) -+ 140 buildings 

+ 90 (educational advisers) + 110 (workbooks) = 1 390 cruzciros. 

The total fixed costs are as shown in Table 25. i 


TABLE 25. Ceará TVE: total fixed costs (in thousand of 1978 cruzeiros) 


976 75% 18% 

Production of television programmes 
Broadcasting — E 8:370 ot 
Total for television 8. 3 1,810 fe 
Preparation of workbooks BE 5 10,180 EB 62 
Administration "d Ped p n 
IEEE 2 _ ies 
TOTAL 14,226 15,539 17:137 
o e OBS. Lo ME 


The total 1978 cost function (TC) (at 7.5 per cent interest) is 


TC, = 73 X N + Fg 
TCs = 1,390 x 1,980 + 15,539,000 
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The unit cost (UC) is therefore 


F 
UC; = Vig + W 


UC =1,390 + 785 = 2,175 cruzeiros. 


With the same number of pupils as in Maranhão, the cost in Ceará 
would be 2,585 cruzeiros per pupil, or substantially less than the 
FMTVE’s 3,660 cruzeiros. This is because FMTVE fixed costs, par- 
ticularly for production and administration, are significantly higher. 
The interest rate applied makes relatively little difference: at o per 
Cent the cost per pupil drops by 67 cruzeiros and at 15 per cent rises 
by 8o cruzeiros, a difference of + 3 per cent, which is probably less than 
our margin of error. Lastly, the annual cost per pupil is $135 at Ceará 


and $225 at Maranháo. 


Conclusions 
In our view there are five important aspects of the cost analysis of these 
two systems: cost structure, cost functions, problems of optimizing the use 
of resources, comparison with other educational or non-educational tele- 
Vision system, and comparison with traditional education systems. 


Compari 

tson of cost structures . e à 

Our major categories of cost are NOW established: administration, pro- 
Uction, broadcasting, reception and utilization. When these “a ee 

Pared, the total costs for the two systems work out as shown in Table 29: 


TABLE 26. Cost structure of the two systems 


(in thousands of 1978 cruzeiros) 
Ceará (1978) 
ee 


Maranháo (1976) 

NENNEN "s ee 
Admin; r 2,494 6.0 
in 10,975 pei 1954 25.2 
ction 12,127 * n 3.0 

r i i 44 
Ree casting 1419 a ? 27,522 65.9 
Ption? and utilization 24,169 49" pee ae 

Torar 48,691 100.0 41,77 


*- Including printing costs for workbooks. 


isi i its account 
The clos Its is surprising. Production cos 
e f the results 15 
for the sarié dise eren (a quarter) of the totals but are à little G 5 per 
cent) higher p Poke’ figures in anháo. When a = à 
E the fact that Maranháo's television program 9 Ceart’s, ire not 
phisticated and that its production facilities, " , 
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used for non-educational broadcasts, production costs may be regarded 
ii eo iets may be drawn from an examination of broad- 
casting costs, also identical in percentage (3 per cent). The Ceará 
network is more developed and hence more costly but it is also better 
utilized since it transmits a higher proportion of non-educational pro- 
grammes. It should be noted that Maranhão has recently changed its 
policy in this respect and programmes not related to school television, 
non-existent until 1977, are becoming increasingly numerous. This, 
however, should not raise hopes of lower broadcasting costs in Maranháo 
since current efforts to extend the system’s coverage are concentrated on 
less-accessible regions. 

Reception and utilization costs, for their part, account for half the 
total costs in Maranhão and two-thirds in Ceará. This is a question of 
scale since Ceará has more pupils. On the other hand, unit costs are 
rather lower in Ceará though there is, in fact, very little reliable infor- 
mation on this matter. . 

This result seems illogical and should be treated with great caution, 
since the teacher-pupil ratio would strongly suggest the reverse. The 
average size of classes in Maranhão was, in fact, forty-one in 1976 as 
against a little over twenty-nine in Ceará (1978) i.e. over 25 per cent 
less pupils, which ought to increase Ceará's variable costs. 

If an opposite result is obtained, the reason is firstly because 
Maranháo's teachers are better paid than their counterparts in Ceará. 
It must be realized that the salaries of teachers with the same qualifi- 

cations are not uniform throughout Brazil but vary from state to state 
and according to whether the school is a federal, state, municipal jor 
private one, etc. Furthermore, the class teachers in schools associated with 
the Ceará television scheme do not all have the same status but retain 
that of the school they work for. In Maranhão, on the other hand, they 
are all paid by FMTWE and for this reason might be in a position to 


them are small, 
ably have their 


should not be given undue importance. 


One more factor also distorts comparison in an unexpected way. This 
is the geographical distribution of Schools. FMTWE is mostly concen- 


trated at São Luís and in the Surrounding towns and villages whereas thé 
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a spreads out much more into rural areas. This ought to make 
foe costs in Ceara higher (communications, distribution of work- 
- pe but they are in fact lower, for the following reason. 

ME inis js in five vehicles with drivers for its contacts with the various 
ili ir] Á a k of resources obliges the Ceará TWE to proceed in less 
wees as en. The workbooks are got to the schools by any means 
Bote sag up by a passing teacher or villager, for instance—visits 
ui nd fat between and feedback minimal. Costs are lower but the 
i af cette is different too, another reason for emphasizing once 
of inn peace ra has its limits. It should also be noted that the costs 
fe ng un workbooks distributed to pupils are particularly low (less 
E 10 per cent of the variable cost per pupil) when set against their 

ontribution to teaching. 
ie ee only substantial difference concerns administration costs, which 
Mats : times higher in Maranhão than in Ceará. This is chiefly because 
on nháo decided to administer the schools in the project directly 

hereas, in Ceará, they remain under the usual authorities. 


amps of cost functions 

s two cost functions are: Maranhão: TC(N) = 24,822 + 1,856 M; 

eará: TC(N) = 15,539 + 1.390 N. They are plotted on Figure 2. 

P In this figure, the difference in unit costs between the two systems is 

Xpressed by the broken line OA which is itself made up of OB’ (effect of 
1 difference) and AB’ (difference 


in variable costs—about the two-thirds of total difference). 
s, the Ceará TVE is big enough to 


further 200 cruzeiros. 
000 would 


OWer nu? 
io unit costs by 700 cruz 
is therefore clear that Mara 


Optimizing ihe use of resources 
€ have been unable to examine in detail the conditions for optimizing 
the use of production resources in the two projects. Indeed, there is no 
real need because this is clearly not a problem for either of them. Available 
Equipment is used intensively, with Ceará broadcasting for sixteen hours 
ls day, of which ten hours are produced locally, mostly live, and Maranháo 
Putting out eight hours of school broadcasts plus a growing proportion of 
s ]. cultural or light entertainment—in the 
Maranhão scheme will pursue and 
grammes not related to school tele- 
proadcasting to schools. On the 
tice, to buy equipment for 


Other 
zm hand, the plan, not ye npme 
4 The new costs implied are 


ted with reserve. 
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1978 cruzeiros per pupil 


6,500 
5,500 
4,500 
3,500 
2,500 
Maranhfiao 
1,700 
—L- 4 i— S 
O 5,000 10,000 15000 20,000 30,000 40,000 50,000 60,000 7000 


Number of pupil 


Fic. 2. Cost functions of the two projects, 


Lines A indi " ion of 
the two systems at the time of this report. and B indicate the actual situatio 
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ee and the educational advantages uncertain and, in all prob- 
ability, impossible to determine with the available means of evaluation. 


ruens with other educational or non-educational television systems 
Ls best known systems of educational television are that of the Ivory 
oast, and the Open University in the United Kingdom. Both have been 
subjected to economic analysis and show much higher programme 
production costs for far fewer hours of broadcasting than is the case in 
Maranhão and Ceará. The distinguishing feature of the two Brazilian 
systems is that they possess their own transmitters and the beginnings of 
a relay network whereas the other two make use of extensive networks 
: ready in existence (full coverage in the United Kingdom, and almost 
ull coverage in the Ivory Coast). Such differences reduce the possibilities 
of comparison, yet our impression is that the two Brazilian systems, which 
are entirely run by local staff, organized in a practical way and well 
attuned to local conditions, have no reason to be ashamed of the 


Comparison. 


In comparison with non-educational television systems, Maranhao 


and Ceará stand out by their refusal, as a matter of principle, to insist on 
Professional’ standards. Resources are limited and they are content with 
Straightforward products commensurate with those resources. Production 
oo are kept as small as possible, with an emphasis on amateur resource- 
ulness that would probably shock professionals but without which there 


Would be no television for schools. 


Comparison with traditional system of education Me 

n comparing the Maranhão an th traditional systems, 
i i is the very considerable 
which results in an 
extremely wide range of situations. il per year for the 
fifth to eighth years very probably varies from 500 to 10,000 1978 cruzeiros 


according to whether the pupil is at a very poor municipal school in a 
da ate school in a rich state. In Ceará and 


Poverty-stricken state or at a priv - 
aranhio the gap between the municipal school of a remote village and 
the smartest private school of the capital is probably as wide. i 
We consider that the quality of education provided by television 
Schools in both systems falls midway between that of the state schools in 
Ortaleza and São Luis and their four or five top private schools. The fees 
9 these non-subsidized private schools, which may be regarded as unit 
Costs, vary from 4,000 to 6,000 cruzeiros per year, a lot more than the 
Sures arrived at in our cost analysis of the two projects. h 
Compared with state schools in the two capitals, it may be said that 


Ceará TVE unit costs are roughly the same and those of the FMTVE 
i y the information at our disposal, we 


believe that the costs of the two systems are not excessive. 
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General conclusions 


Analysing the cost of a project is not an end in itself: its ne 
help gauge the pertinence of the technological choice made. This md 
fore calls for further information, namely the value of the product we 
by means of the resources employed. In the present state of knowle pa 
however, it is not yet possible to measure, with the aid of economic in 
cators such as monetary units, the absolute value of an educational ipee ed 
We have to fall back on relative criteria such as ‘at the same cost, wha' 
educational technology leads to the best results?’ or ‘for the same results, 
what is the least costly educational technology?'. — 
What is here called ‘product’ or ‘results’ is really a many-tider 
phenomenon whose evaluation requires a wide range of standardized an 
carefully prepared data that are, unfortunalety, rarely available: data on 
access, repeaters, drop-outs, examination passes, indirect social effects, 
and so forth. = 
In Ceará, the school television system is still too young for a sufficien 
number of results to be observable and the budget is so tight that little 
can be spent on evaluation. d 
The Maranhão project, on the other hand, is more established an' 
more concerned with evaluation, This explains our success in gathering 
together a few partial indicators. Nevertheless, they are not enough - 
Support a true analysis of cost effectiveness since there are no othe 
strictly comparable systems about which similar data are available. 


Remarks on the effectiveness of school television 
in Maranháo 


FMTVE pupils have two dominan 
modest social background and are 
pupils, being generally less well- 
classes. Secondly, their standar 


t features: they come from a "E 
much poorer than private-scho™ 
off than most pupils in fifth-to eighth-y¢ " 
d on entry is low. Judging from the tes 


TABLE 27. FMTVE: promotion, attendance and drop-out rates 


Meats ee f We Me eS et 


ear Promotion rate 


Attendance rate Drop-out it 
1969/70 98.0 zu 3.8 
1970/71 98.2 is 2.5 
1971/72 98.6 92.0 2.1 
1972/73 98.5 96.0 Adi 
1973/74 97-4 94.0 5.2 
1974/75 93.2 91.0 9.2 
1975/76 91-5 91.0 74 


Source: FATVE/CEPI. 
SS a RN an Be ee 
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they have to take, they know only a third of what is theoretically required 
for admission to this level. 

The promotion, attendance and drop-out rates shown in Table 27 
may be regarded as good, comparable to those of private schools and 
certainly better than those of pupils from a similar background in other 
Schools. ‘ 

Table 28 compares the results of FMTVE pupils with those of 
pupils from private schools in the São Luis area in the entrance examin- 
ation to (upper) secondary education in 1973 and 1976. In 1973, a 
perfectly equal competitive examination saw FMTVE pupils obtain 
markedly better results. Although the 1976 results again show the clear 
Superiority of FMTVE candidates, they are more difficult to interpret 

ecause social criteria in favour of the children of low-income parents 
(and hence FMTVE pupils) were applied in the entrance examinations 
to one of the leading upper secondary schools. 


Taste 28. Passes in entrance examinations to secondary schools 
Number of Number of Percentage of CER of 
candidates passes all passes candidates. 
id FMTVE 1,127 687 43.0 60.0 
ther schools 2,548 894 57.0 35:0 
Total COE ia) 
,6 1,581 100.0 
648 FMTVE ne 1451 58.6 543 
ther schools 2,985 1,026 414 344 
100.0 — 


"0906 5,675 2,477 


asonable to conclude that 


s efforts to transform a population initially 
homes into a very active group with a high 

Its work is a powerful stimulant to social 
tent that social mobility depends on 


F Despite these reserves, it is not unre 


ill. VE is succeeding in it 

"prepared and from poor 

Po of success at school. 

suc ility within this group to the ex 
Cess at school. 


Results of school television in Ceara 


Unlik 4 TVE are not from a par- 

i € Maranhão, the pupils of the Ceara ; 

ticularly Od isl background. In the capital they are 

rather like the pupils in state schools and, in the vi " the state, a. 
€ to th i ivate and municipal schools covering e 

bi eighth Lic ud ern repeater and drop-out rates are much 
© sa a i ae 

me as in traditional schools that the system has reached a 


s for access, it should be observed ystem | 
Workable size in k few ycars This is certainly a point 1n its favour, but 
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it is not known what proportion of the pupils are from existing classes 
that have simply joined the scheme, as against newly created classes. 
However, it can be said that, for many pupils in rural areas, the system 
has helped increase their chances of access to the last four years of basic 
schooling. . 

The information at hand is very limited but warrants the cautious 
judgement that the results are no worse than in other comparable schools. 
Moreover, the fact that the system, based as it is on voluntary association, 
has expanded rapidly is strong evidence in its favour. 


Final remarks 


especially as, in this c. 
comparison. The s 
should make it poss 
in basic concept. 
new ideas since i 


he day. 


à . . : 
Tojects, developed in two poverty-stricken state 


Wn resources and local skill, may be regarded 25 


3 € 
to the search for the educational solutions of th 


In sum, these two p: 
with nothing but their o 
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Costs and effectiveness of distance learning 
at the post-secondary level 


Leslie Wagner 


Introduction 


T. 
p ud theme of this study is the ability of economic analysis to 
ham - 1minate and influence decisions on the use of media for distance 
MS at the post-secondary level of education. 
os mi Systems provide further education facilities for adults to 
are cases "s to study subjects missed or under-achieved at school. These 
re er e the age of the student will be post-secondary but where the 
such syste remains at the school level. This study is not concerned with 
and the | ms but concentrates on those where both the age of the student 
WE level of education is post-secondary. 
be muc uad deals with economic concepts, it is written so as to 
economie chensible to non-economists. It is not merely concerned with the 
c analysis of media but with the relationship between economic 


analysis : 
ysis and media decisions. 


ii Dost-secondary education different? 


Doe 

s i 

that _Postsecändary education h 
t require a different analysis © 


us H : 
i bier, be our first question for i r is n 
ent from school education in this respect there seems little point 1n 


“g -. i i Pi 
NC rate analysis. The lessons of using media in school education or in 

ing could simply be applied to post-secondary education. - 
here are of course some gen cs of media use in 


guishing characteristics 
f the use of distance-learning media? 
f post-secondary education is no 


ave any distin 


eral characteristi 
all levels of edu- 


educa 
"cation, particularly on the costs side, that apply to a! 
the use of media changes the 


Catio : 
Prod, In the language of economists, i : 
M function of education. More he ratio of capital to 

r for any give amount of educati 1 The use of print, 


generally, t 
on increases. 


1, B A * i 
It might be useful to amplify this 2 little. In accounting terms capital is usually 
regarded as a fixed cost and labour as 2 variable cost. This is because the terms 

the particular accounting period. In 


fiy 4 
M and variable are related to time or c 
Onomic terms, any capital costs would be annualized (see page 13 for expla- 


Dation of the method adopted) and the terms fixed and variable would be related 
9 a particular output. In education, for example, student or pupil numbers 
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radio, television, film, etc. requires capital equipment which mU m 
labour input for a given number of students, or more usually, : s 
larger number of students to be taught for the same amount o i a a 
(i.e. teacher) input. As a result, the general cost characteristics o ees 
systems in relation to more conventional education systems are a S a 
level of initial cost, a lower level of marginal cost once the system 1s ^ 
operation, and a more rapid fall in average cost as the system Cp e d 
These general lessons are important and will be illustrated by ss 
examples given later in the study. However, post-secondary eem 
does have specific characteristics which affect the use of distance-learnt E 
methods and have implications for costs-and-effectiveness analysis. —. 
As mentioned earlier, post-secondary education is defined both 2 
relation to the age of the student and the level of the curriculum. In othe 
words, it is assumed that the students participating in the system are Es 
post-school age and the curriculum they are following is also at the po» d 
school level. These two features can have important effects on the ieri 
learning system adopted and any costs-and-effectiveness analysis of such 


i : i n DM 
system. A third feature is the external economic and educational enviro. 
ment within which such systems operate. 


Age and maturity of student 


By definition, the post- 
lescence and in some ca: 
and, in particular, 


secondary student will be at least in late p 
ses older. This has implications for the media mi 
the balance between media and live instruction. . 
There may be sound pedagogical reasons for an element of live 
face-to-face, personal interactive instruction in any educational y pen 
Indeed there are few systems at the post-secondary level which do A: 
include such an element. However, where school-level education 7 
concerned this is essential and not necessarily for any intrinsic pedagogic? 


reason but simply to maintain order and ensure that attention is being 
paid.t 


ren to be left entirely on 
n the vicinity. Moreover, lear 
m leaving up to thirty or pdt 
mmes of a quality that allows e 
cost implications. It may be more C 
With an element of supervision. 


own in such a situation. A parent is somewhere i; 
one or two children unattended 
in the same situation while to produce Progra 
personal supervision is likely to have high- 
effective to go for lower technical quality 


ing 
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takers suc marinis ge ra an Kn rie Ulan et 
personal supervision el conons Rip es "i ge M 
iibxatih nei element. Economies are still possible within this 
Higher pu il cis The personal supervision element may allow a much 
the FA i er ratio than would be necessary ifall tuition came from 
I rens 1 ternatively, the use of media may allow a less expensive 
"The Mexic e mue for a more expensive one. (See, for example, 
T cw. an elesecundaria: A Cost Effectiveness Analysis’, Instructional 
caion Fr c Mexico's Telesecundaria’, The Economics of New Edu- 
schocl-level ef ol. 15 Unesco, 1977). The major point still remains that 
‘Meike education requires a personal supervision element. 
impórtant post-secondary level, supervision is not required and this has 
inherent $E implications. In principle, it allows the economies of scale 
being dif. F use of distance-learning systems to be optimized without 
Tekeri] v 1 through a large and more costly face-to-face element. The 
Miri ility to reduce average costs significantly below the figure for 
tiieie x education is not constrained by the need to include major 
realized fr this more costly alternative. How far this potential ability is 
teristic ns practice will be discussed later but it is an inherent charac- 
media Post-secondary education that the age of its students provides 
use with its greatest cost-reducing opportunities. 


Nature of the curriculum 


im of curriculum is also post-secondary is 
Portant, particularly for effectiveness studies. For the nature of the 

likely to be different from that in school 
es of a particular system of 
d the skills to be acquired 
ndardized tests capable of 


educati 5 me 
cation, In the latter the cognitive objectiv 


s 
“andardized tests useful for comparative purpos 
effecti his difference is reflected in the paucity of stu 
Party ee of post-secondary distance 
een reflects the novelty of these systems. 
ven n existence sufficiently long for any useful s 
lofted on systems of longer duration, however, r 
that h study of their educational effectiveness. The usual assumption 
as been made is that a pass in the distance-learning system 1s 


1, > " " 2 " 
Attempts to overcome this have been made in certain subject areas including, 
appropriately enough, economics. See, for example, publications by Attiyeh, 


ach and Lumsden (1969) and Attiyeh and Lumsden (1971, 1972). 
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equivalent to a pass in a conventional-learning system and the edu- 
cational effectiveness of the media system is thus determined by the 
comparative pass rate. 

Even if some more objective, standardized measurement of the 
cognitive effectiveness of such systems was devised, this would not 
necessarily be the major factor in determining educational effectiveness 
according to Carnoy and Levin. In a review of a number of studies of 
using instructional technology in both school and post-secondary edu- 
cation, Carnoy and Levin (1975, p. 390) comment: 


In almost all cases a narrow measure of educational attainment is used to 
assess educational outcomes or no measure of effectiveness is used at all. Is it 
appropriate to assume that students receiving videotape instruction in factories 
are receiving the same education as those on campus who have regular access 
to faculty, other students or libraries? Is it correct to assume that the value of 
an Open University degree will be similar to one from Oxbridge or the *Red 
Bricks’? Such a presumption simply ignores the credentialing effect of higher 
education institutions as well as the fact that Open University students are 
not being socialised in the same way as their counterparts in traditional uni- 
versities. The latter students are spending most of their time in contact wi 
fellow students, faculty and academic facilities that go far beyond the short 
ro to course instruction and required instructional materials. 


Carnoy and Levin thus argue that measures of cognitive effectiveness 
would only be part of the overall educational outcomes of a particular 
System. The relevant question is whether what is omitted by a cognitive 
measure alone is important. If cognitive achievement is our major 07 
only objective, then this becomes our major or only measure. Carnoy a? 


Levin (1975, p 391) ` á Ó 
75; P- go on to argue against this a h by questioning 
the assertion in most effectiveness studies that uidit: 


eneralizing thi 
Schramm 1967; Schramitn m 


—-— nra deu: expl i the claims of ‘equal success’ in educational 
and derives from a narrowi £ : cce: 
i i tes su 
to the specific test instrument used to a à ing of what constitu " 
E SSess instructi assessi3} 

the wide range of outcomes that schooling eniteibuts €: than to 

ES vr m criticism is largely related to the educational refor? 
objectives of many distance-learning systems in both school and pos” 
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secondary education. While it is necessary to bear in mind that a 
Cognitive measurement is a narrow one, it is at least a start. In many 
distance-learning post-secondary systems such information would be 
a major advance on what we know at present about their educational 
effectiveness. 

There is a further aspect of the nature of the curriculum in post- 
secondary education which has implications for the analysis of distance- 
learning systems, this time on the costs side. Radio and television media 
in particular have both a production and a delivery component. It is 
Possible to use the delivery component alone to expand the student 
audience for a particular piece of instruction. In other words, radio and 
television allow some conventional instruction to be made available to a 
larger number of students than might be able to attend at the time and 
Place at which that instruction is given. This audience can be either on 
or off campus and the instruction can be delivered by a variety of 
transmission mechanisms. The systems can be used for live or recorded 
broadcasts and with live systems in particular student-teacher interaction 


can be accommodated. E à 
Television and radio also have a production capability to provide a 
form of instruction different from that normally experienced in the 
Classroom. This can involve the use of many audio-visual aids such as 
films, Slides, charts, diagrams and cartoons together with dialogue _ 
t aterview material. Programmes involving these methods might * 
esigned to teach material which cannot be taught through rar in 
Scture procedure or to enable more effective learning to take place 0 


to allow th 3 

e student to learn more quickly. EM y 

In school education, television and radio are used mx vw D 

duction and delivery capabilities. Itis unusual to see the media E : g a 

Simply to duplicate what is taking place in the eom med 

| Srammes at th least are usually specially prepared, ^o i 

.Carning once. Dd post-secondary education the delivery i ee 

eg by itself much more often. Of the ener SURGE 

Anford Television Service and the Colorado gue der 

wG ct simply extend what is already taking place on t ns me a 
udience, No special programmes are made and the audio-v1 


u . > 
= mrs echec Pen Té delivery component of an 


he costs implicati hould be clear. : 
simplications shou n onent. 
9-visual mui is much cheaper than - pode sse ations 
particularly if transmission can use an existing € t-secondary rather 
actor likely to reduce the costs of using media 1n pos 


tha 
n school education. 


i ironment 
External economic and educational enviro 
i ition. This is not 
Sas antial teacher opposition. | 1 
hing, forthe € Lae p the economist —substituüng capital 


u A 
"Prising, for the dry langua 
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for labour—is instantly translatable by the teacher into substituting 
machines for people and the loss of jobs. As a result the use of media in 
education generally falls into one of three categories. 

Media can be used within the existing system to supplement the 
teacher input and thus increase the quality of the overall educational 
input (although not necessarily the quality of the educational output). 
Many of the audio-visual aids found in most schools and colleges or the 
public educational radio and television broadcasts come into this cat- 
egory. The teachers in the classroom still control the pattern and content 
of study and use different media to help them in this task. The media do 
not represent a threat to their job security. 3 

The second category is where media are used to extend opportunities 
to students not already participating in the educational system Or a 
particular part of it. Here media will be used to overcome educationa» 
geographical, physical or social handicaps either by extending existing 
conventional tuition methods to this wider audience or by establishing 
new approaches, institutions or systems. The objective of such provision 
may simply be to extend opportunity provided quality is no worse an 
costs no higher than the existing education provision, rather than to 
improve quality or to reduce cost. Here, too, there is no threat to existing 
teachers since the system is being expanded. Although it could be argue " 
that as a result of using media fewer teachers will be required than ! 
conventional methods had been used, it is also often the case that 2° 
expansion would have occurred if the conventional approach was y 


only method available. In any event expansion using media usually 

involves some increased use of teachers. 
The final cate 

tives of either imp 


Here teacher agreement or ac 


: A he 
A 5 : "Visual sections which carry out t 

functions previously described. They contribute only marginally. however? 
to distance-learning jecti i : : 
often separately consti 
supplement and im 
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unlikely, or isi 
för which js ee a raising of the compulsory schooling age, the scope 
istance-learning systems in develo; d i 

cake ped economies therefore 

syste e ee age group. The level of education Por 

tena mu however, be both pre- and post-secondary. Many sys- 

provide adi. into operation are of a remedial nature, attempting to 

define. Di s with skills and concepts appropriate to school-level edu- 

lesaland « i are at the post-secondary or specifically higher-education 

anri empt to expand opportunities in this area for those qualified 
entional higher education while also maintaining and with an 


Open. 7 
ME ie no-prior-qualifications approach. i 
en le pans on of post-secondary education is not the most urgent 
sony educa ncern of most developing countries. Here, where compul- 
ation may only be possible up to primary level or where 


geo i 
graphical or other problems make comprehensive provision difficult, 
xtend school education. This is 


the prior; 
Feel eua d for media-system use is to € 
Media. V, deg the studies mentioned in The Economics of New Educational 
Araton 2 . 1 (Unesco, 1977) and the World Bank publication, Radio for 
In Ges Development: Case Studies (1977): : 

Systems iew of the above it is not surprising that most distance-learning 
Ho at the post-secondary level are found in developed economies. 
of Iran, re exceptions, such as the Free University of the Islamic Republic 
regar d the Everyman University of Israel, but these are usually 
analysed as special cases. Inevitably, therefore, the studies now to be 
ed have a developed country context. Nevertheless, it is hoped the 
As other countries become 


analysis wi 
ee Sis will be of interest to a wider audience. 
interested in extending media to provide distance learning at the 


Post.: K 
a dary: level there is much to be learnt from the experiences of 
who preceded them. 


SYste: 
"stem : : 
S eis specific characteris 
€ age and maturity of student 


there n 

nt in media systems to be full exploited. 
F e y lum. The broad analytic 
ducation make it more 
The result is that 


f equal v 
wel isi of tuition. On the costs side, the nature o 
sion and radio to be used for their delivery cap , 
anded at very low marginal cost. 


Enab] 

i 

FE student numbers to be exp i : 

edu, Ally, the context in which media systems are introduced into 
tion means that distance learning at the post-secondary level takes 
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place almost exclusively in developed countries. The lessons to be learnt 
from these pioneering efforts will, it is hoped, be of use to others when 
they come to extend their media systems to the post-secondary level. 


The studies chosen 


While increasing numbers of post-secondary distance-learning systems 
are being established, the number of cost or effectiveness studies of such 
systems is relatively small. Many innovations are too recent for any usefu 
study. Moreover where an analysis has been carried out, this has often 
been for internal purposes and the data have been organized and cat- 
egorized in a form which makes a comparative analysis very difficult. 
Thus the number of studies which provide reasonably reliable data 
capable of being compared and conforming to the methodological 
approach outlined in Volume 1 of The Economics of New Educaliona 
Media is very small. 

,. Four studies have been chosen. These reflect not only a variety of 
different media approaches to distance learning but also point up the 
different lessons to be learnt from each study. The Open University m 
the United Kingdom has pride of place not only because it has been more 
thoroughly studied than other systems but because it provides the most 


ance-learning education. 


T he context of the studies 


Any consideration of the relevance of economic analysis to decisions about 
the use-of educational media requires that the usefulness of these stu 

to various types of decisions be established 

__.., Many decisions are involved in the use of media. There is ° 
initial decision, to begin at all. How can cost analysis influence and hel: 
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to infor I EE” 
M. rc yn = vien This will be subject-matter of the next section 
"There are study will be used as an example. 
There indde er decisions to be taken once a project is under way. 
civandel. Cla hi hether the project should be finished, continued or 
these nus iis eer Si analyses are particularly relevant to 
Rane ecisions as the Open University and Colorado studies 
" "ed een are decisions as to how the benefits from any cost 
dor p from the learning system should be allocated. There 
(ie ains TO possible beneficiaries which include the provider of funds, 
inistration of the institution, the teaching staff and the students. 


Th 
e Stanford study illustrates this particular question. 


The initial decision 


The init 

1 fel " P . 

nitial decision to introduce a distance-learning system may take a 
d in stages from experimental 


Vari 
mn ara It may be implemented ir E 
pletely i A ot to full project status. It may involve establishing a com- 
what d ependent system or one which in a variety of ways builds on 
media ready exists. It involves complex questions of establishing the 
mix linked to educational and wider objectives. 
iude essential cost information required at this initial stage will 
Student total cost, its distribution between various partners (including the 
the ny s) and average cost per some measure of output which is usually 
etw. MEE of students. In accounting terms, total cost is usually divided 
m Sree capital and recurrent costs. In economic terms, the capital cost 
appro erted into an annual cost of capital services through the use of an 
Tate " riate interest rate (to measure the cost of capital) and depreciation 
Biven b measure the wastage of capital). The formula for this conversion 
y Jamison, Klees and Wells (1976) i5 


(r(x 4 09 
(x4 0'-29 
st which on public projects 


Where Sie 
e of discount and 


the appropriate rate of intere 
would be equal to the social rat 


n = the lifetime of the capital. . 
"i Pde e cost of capital services 1$ then added to annual recurrent 
O provide a total annual cost of the project. —. : 
learn} here the approach is to use OF puild on toa media or other distance- 
initial & system that already exists as at Ci do and cee wi 

€cision is ifficult. The resourc ment is relatively 
a likely to be known. The 


Smal] 
and the costs and student demand are 


This " 
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introduction of the system is in the nature of a marginal addition to what 
1 1 
— where a new system is being introduced these iege 
elements of initial resource commitment and knowledge of costs and o 
demand can make the decision a very difficult one. The initial resource 
cost of a self-standing distance-learning system is likely to be much larger 
than that for a conventional learning system because of the higher 
threshold effect in the former. In a conventional-learning system costs 
(inputs) are much more closely related to student numbers (outputs). 
While some threshold is still in operation, it is at a much lower level an 
a new college or university can be introduced on a relatively small scale 
with a low level of resource commitment. . 
This, of course, does not always hold. It can be argued that to provide 
an adequate range of courses a college must be of a certain minimum 
size which will involve capital and recurrent resources running into 
millions of dollars. Even if this were so the risks involved in such a 
expenditure are not as large as with a distance-learning system because o 
the uncertainty over the costs and demand data associated with the ie 
A conventional-learning system by definition uses convention 
technology. The costs associated with establishing an institution of a 
certain size can normally be forecast with a high degree of accuracy, 45 


numerous models exist on which these forecasts can be based. Demand, 
too, is usually guaranteed. The 


usually comes from the dema: 
been made it is unlikely that s 
Hence, forecasting total cost, 
student can usually be done 

Moreover the penalties 
great. Because of the closer proporti 
and outputs a fall-off in student numb 


i A ircui 
for live lectures, to provide close-cire 


5 É ec 
E earning system, what is the corr 
allocation between these th 


ree different uses? 
m is more of a 
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ie D y to conditions usually characterize a distance-learning 
e d "x e costs side, each system tends to use a different media mix, 
hea " T models often do not exist. It is difficult to take an 
NE : el off the shelf and duplicate it. Most distance-learning 
opens re har built and their cost estimates must be built up 
i ea y. Furthermore the technology in this arca is changing far 
a few apidly, so that even if a system uses a similar media mix to one of 
Feed years ago the cost components of that mix may have changed 
gnificantly. Hence cost estimating 1s a much more uncertain business. 
"E estimating is also much more difficult. Distance-learning 
iom are often introduced to further educational reform. At the post- 
S ary level they have been designed to overcome educational, social 
a ks : "d xim disadvantages. When the systems are being advocated, 
Bus a} e Open University or Colorado State University, it is argued 
whic h atent demand exists. But an accurate forecast of the extent to 
7 this potential demand will translate into reality 1s often not 
ee Establishing a distance-learning system in post-secondary edu- 
n is, as far as demand estimates are concerned, very much an act of 


faith, 
bees a anice earning systems are therefore likely to involve high initial 
ttim ‘hese together with the uncertainty attached to cost-and-demand 
fine make the decision to go ahead a difficult one. There isa 
nah er complicating factor, however. For the picture facing the decision- 
b aker after he or she has made a decision is vastly different from that 
eforehand. Once the project is und the high capital costs have 
res incurred, the programmes or courses have been made, and the 
ne pment is in operation. The actual costs to be saved from drastically 
Ucing the scope of the system if demand is not forthcoming are likely 


to be very small. 

á Cost-and-demand analysis at the initial stage thus has a heavy 

esponsibility. Faced with the uncertainties involved, it may be all too 
f cost and the 


er way, 


t : : 
€mpting for the analyst to take the lowest estimate of € 1 
ghest estimate of demand in order to indicate the potential BP 

student 


tly the average cost-per- 
it can be argued that in the 


a 
Vantages of the system. If subsequen 
with low marginal costs 


been too low, : 
ation 


I 
th 
fes problems can be a 
oo of changing various inp’ 
€ example above the effect o! 


ut assumptions 
f differing cost- 
]culation wou 
-o for different time 
Klees and Wells (1976) discuss this in 
Ome detail and their publication should be referred to for fuller infor- 
decision-maker to assess average costs 


hehe: 
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at any time i over any projected life of a project j. Thus at the B 
stage, i may be the year before the project is introduced and j may be li- 
periods up to ten years. Here the decision-maker can see the cost eed 
cations of going ahead now but stopping the project in any year 1 to Les 
After the project has started i may be any year during its life. Thus i 
decision-maker can see the differing cost implications over differen 
time perspectives. . 
The PLATO project is perhaps a good example of the difficulties of 
cost analysis at the initial stage and the implications of incorrect torere 
Two statements must be made at the outset. First, the only availabe 
published data relate to the initial cost estimate. While ig eel 
costs-and-utilization evidence will be cited, this is unpublished. Howeve 
there is no reason to doubt its broad accuracy. Second and most importanu 
while the initial PLATO estimates underestimated cost and overestimate 
demand there is no suggestion whatsoever that this was not a best estimate 
at the time. The PLATO data are included because they are of intrinsic 


interest and because they illustrate very clearly the problems of cost-and- 
demand estimating at the initial stage. 


PLATO 


PLATO (Programmed Logic for Automatic Teaching Operations) is er 
attempt to provide a complex and sophisticated computer-based edy 
cation system. It began in 1959 at the University of Illinois and after 
number of developments, the latest model is PLATO IV. ; 

The versatility of PLATO IV is explained by Alpert and Bitzer 
(1970). In this system the computer is not programmed to accept ? 
simple correct answer. It uses an algorithmic approach to respond to 
student answers. The computer can be programmed to distingus. 
between an incorrect or nonsense answer and a spelling mistake and * 
also able to respond to unpredicted behaviour. 

Thus Alpert and Bitzer argue that 


teaching strategies which do not call 


for specified student responses are widely 
used... . For example geometry students may be called upon to ‘draw’ on t 
PLATO graphic display a figure that has s 


ies but 
pecified geometrical properties ÞU 


need not be of a parti ven location on the screen. 


cular size or in any gi 
Alpert and Bitzer further argue that computer-based instruction ca? 
develop critical thinking 


: ing and analytical skills. They cite an example ° 
an ‘inquiry’ mode of instructi 


Case-studies 


237 


NEM. of the PLATO IV system is the central computer which 
forthe m Tb rapid-access memory and main date-processing facility 
(Série n E e tasks required of itensure the need for a very powerful 
led onde tie ii computer. Linked to it is a software system for organizing 
Jara aching, testing or research strategies and for specifying the 
$ Toe which directions to the computer are to be formulated. 
‘ies e M student terminal through which the student works has 
d m w hich the student uses to respond to questions from the computer 
metn d instructions and also a plasma display panel on which 
hanne) s, instructions and visual images are shown. A distribution 
individu "i required for carrying information between the computer and 
able aan „student terminals. Numerous alternative models are avail- 
| eem indeed these have different cost implications (see Ball and 
d bs a , 1973). The optimum system depends on the number of terminals 
sión eed and the length and geographical nature of their disper- 
eb - The PLATO system uses coaxial (television) lines from the central 
mputer to various distribution centres and telephone lines from these 


ce La : 
io: to individual terminals. 
hese three items, computer 


mi CRIME Ree $ 
$ Ta and distribution channel, consti 
cation system, In addition, when costs are considered the management 


mng instruction costs should be included. The components of the PLATO 
ig are the hardware by which the interaction of education takes 
LM The costs of producing the content of that education and its 

anagement without which the hardware would be irrelevant must 


also be considered. 1 
ding mme analysis of PLATO IV hse pani an mee eem 
conta, operational costs of the system would am ^ N P " 1 
Cost ct hour with a further $0.35 per student contacthour or instructional 
(i.e. authors and supportive services salaries plus materials, etc.). 
ey the total cost per student contact hour was estimated to be about $1. 
iius assumed that these costs are in 1969 prices although no explicit 
ement to this effect was made. 
ne Latest estimates of PLATO IV costs per student contact hour are 
E arer to $5. A small part of this might be explained by the rise in prices 
nce 1969, However, some of the items of cost, for example the central 
Computer, would not be affected by this factor. Part of the reason 1s an 
Underestimation of costs on certain items, particularly communication 
and curriculum costs. As indicated previously, communication costs 
prend on the distance of the terminal from the central computer. 
ATO IV has not been able to develop the communication system 
and the alternatives are much more 


envisa, : 
ged by Alpert and Bitzer à : 

y Alpert a the United States cost in the region $9 per 
unication cost 


e : 
Xpensive, A leased line in z 
19705; implying @ large comm 


an T 
qoum per mile in the mid 
terminals some distance from the centre. f 
pert and Bitzer assumed that the instruc- 


On curriculum costs, 


hardware and software, student ter- 
tute the core of a computer-based 
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tional cost of preparing one hour’s worth of material would — T 
about $600 on average. (They assumed that each hour’s worth of mate s 
would be used by 500 students for five years, producing the rae 
cost per student contact hour of $0.25 referred to above.) We shall dis ee 
the utilization factor later. Observers of the PLATO IV system nc a 
believe this to be a serious underestimate although it is difficult to E 
a precise figure. It seems generally agreed, however, that the x 
effort and cost required to produce an hour's instructional materia. 
much greater than originally estimated. Bom 
These cost underestimates, while important, would have ha e : 
effect on the per-student-contact-hour figure if the utilization rk 
envisaged originally had been realized. Itis the overestimation of a tie 
usage which is the main cause of the difference between origina co 
mates and actual figures. Alpert and Bitzer assumed that the syste 7 
would incorporate over 4,000 terminals each of which would be ye 
by students for an average of 2,000 hours per year (45 — as 
44 hours per week) producing an annual number of 8.2 million studen 
contact hours. . i 
However, the position now looks very different. It is generally 
accepted that the system is unlikely to be able to handle more than & 
maximum of 1,000 students at any one time. Allowing for the need for 
some spare capacity, the maximum number of terminals installed 1s 
unlikely to be above 1,250. The evidence on average terminal use 19 
scanty and estimates range from 1,200 hours to 2,000 hours. Thus even 1 
the maximum possible usage was to be achieved, this would prodig 
2.5 million student contact hours rather than the 8.2 million previous y 
forecast. Thus the non-achievement of the student contact target has e 
effect of raising the average cost by a factor of more than 3. It shone 
also be noted that the figure of 2.5 million student contact hours is t is 
new estimated maximum. Present utilization rates are below even thi 
revised target. P 
All this of course needs to be put into perspective. A costs study © 


the PLATO system is useful as an example of the effects of wrongly 
estimating costs and utilization ra. 


be that the likely average cost 
while five to six times higher t 


: à istin 
arginal costs of using an exist 


à om is 
student terminal to follow an existing course are very small, and th 
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would be the lowest cost method of increasing utilization. Increasing th 

number of terminals would, of course, incur extra terminal and an 
munication costs but average costs would still fall even if each extra 
terminal was used for only 400 hours a year which amounts to between 10 


and 12 hours a week during term time. 


Decisions relating to a system in use 


A media system in use requires a large number of planning decisions on a 
regular basis. This includes relatively straightforward decisions on future 
Student numbers, financial resources, etc., as well as more complex 
decisions about changes in media mix, subject mix, and so on. It is here 
that cost analysis can provide the necessary information. The cost 
methodologies introduced in Volume 1 of The Economics of New Educational 


Media are particularly appropriate. . 
In this publication, Orivel reports on meetings of experts to clarify 
* methodological problems involved in cost analyses. One general 
Point that emerges is the benefit to be derived from dividing costs into 
those that are fixed in relation to a particular measure of output and those 
at vary as the output varies, thus enabling the cost implications of 
changing output or utilization to be accurately assessed. t 
th more sophisticated analysis allocates costs to the different areas of 
* system. Thus a media system is likely to involve conception and 
Production costs, duplication and distribution costs and presentation and 
Operational] costs, By identifying the costs that fall into each category and 
relating them to the particular output relevant to that category, more 
useful information for decision-makers can be provided. 
Un; The two studies chosen—the Open University and Colorado State 
of ,Yersity —exemplify this approach. The Open University is, of course, 
in Penis interest as probably the most sophisticated media system 1n S 
Me ag education. However, it should be remembered that we on 
ti to the Open University for an example of the use of cost or € ed 
Veness analysis in the initial decision. It is clear from the accounts o 
“upham in MacKenzie et al. (1975); MacArthur ( 1974); the white 
meet outlining the United Kingdom Government’s policy in 
Cee POTE of the planning committee in 1969, that no detailed ana’ m 
th 5 or demand estimates were available. In the words of Scupham, 
et “ decision to go ahead . . . was a political act of faith (MacKenzie 
f material now available 


Fk > 1975, p. 327). The relatively large amount o à 
the Open University deals with the university as a gomg concern. 
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The Open University 


The United Kingdom Open University is probably the largest and E 
sophisticated application of educational technology to higher oS E 
Established in 1969, and taking its first students in 1971, by 1976 1 en 
incurring an annual recurrent expenditure of some £26 million on a to 
ent population of about 50,000. . 
= Mur aspects of the Öpen University have attracted attention. 
Some are interested in the fact that it caters for mature students, allowing 
those over 21 years of age a second or, in reality, a first chance to pare 
ence higher education. Others are interested in the open admissions policy 
with no academic prerequisites laid down for entry. : 
The major focus of attention, however, has been on the technology a 
learning system which the Open University has adopted to enable it 2 
meet its educational objective of providing part-time higher educatio 
to unqualified mature students. This objective required the establishment 
of a distance-learning system which consists of five main components: 
correspondence materials, television and radio programmes, class tuition 
at local study centres and summer schools. " 
The correspondence materials are at the centre of the learning 
system, taking up the largest 
student time in learning. For 
to students regularly through 
quality course unit text for 


: ich, 25 
xperimental kits which» to 
materials and equipment enabling students 
carry out relevant experiments in their home.1 
The radio and televisi 


of twenty-minute radio progr 
about 360 hours a year ona 


— di 

1. The term *kit is an elastic one and : ds, t2P' 

M S the pai i e records, 
slides, etc. for the student's home use, Package might includ 
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programme is watched twice means that only twenty-four of these 
hours (about 7 per cent) are spent watching the programme. 

_ The face-to-face tuition is also a small part of the total system and 
varies between courses. Its purpose is to provide both personal and 
academic support to students in their own particular locality through the 
Provision of part-time tutors, usually academics from other institutions, 
using the facilities of local colleges in the evenings and at week-ends. The 
maximum personal tuition help is provided on foundation courses and 
amounts to about one to two hours a week. On other courses, personal 
tuition amounts to between ten to sixteen hours spread over the year. 

The summer-school facility is another aspect of personal tuition 
but this time concentrated in a week’s intensive study on a conventional 
University campus during the summer months. Not all courses have 
Summer Sessions, the emphasis being on all foundation courses, science 
and technology courses requiring intensive experimental sessions and arts 
Courses requiring student interaction and participation. = 

he university is divided into six faculties: arts, social sciences, 
education, mathematics, science and technology. Each faculty except 
education has a foundation course and a range of second-, third- and 
Surth-level courses divided into half or full credits." To obtain an 
ordinary degree a student must obtain six credits including two at 
Sundation level, An honours degree requires eight credits, of which at 
“ast two must be obtained at third or fourth level. Students with previous 
a ny ications are given credit exemptions up to a maximum of three for 
€nts with a previous degree. . - 
stud his rit ah system pum in a high fixed cost im pe t 
ent numbers. Virtually all the costs of television and radio pro 
Fores are incurred irrespective of the number of es 
me for the correspondence material where the major Mes eb cd 
Stud, of preparation are fixed and only the actual printing c f y A 
Ent numbers, Even as regards the latter, a proportion of printing 


costs; the setting of type for example, is also fixed. 

i H . 
Lay, na aaor aay of early pen University costs, end ea 
mighty (1974) produced two cost functions to cover Lent rae a 
Tega, t be allocated to the production of courses and those whicl oo d 
un "ded as central university costs. Within these two categories Spem 
(a) p distinguished between fixed and variable costs as fo à » 
instit xed course costs, i.e. costs which are inescapable E a i : 
alte uted; (b) variable course costs, i.e. costs which can be al 
i "ng the number of students in a course; (c) fixed university ig 5 
(a) ey Which are inescapable if the wem: is herons $ 
the p Mable university costs, i.e. costs which can be a 


Umber of students in the university. 


e-third and one-sixth credits to enable 
alf or full credit. 


So " . 
imt Science courses are divided into on 
‘rent courses to be combined into a h: 
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Laidlaw and Layard allocated all costs in 1972 to one of these 
four headings and compared the figures with those obtained for conven- 
tional universities in the United Kingdom. For central university 
costs they found that the Open University costs function in pounds 
(1971 prices) was: 

TCUC = 1,584,247 + 44n 


while for a conventional university the function was 
TCUGC = 130,935 + 1112 


where n is the number of students and TCUC is total central university 
costs. 

The functions for course costs were separately calculated for each 
course then in production and the results are shown in Table 1. While 
the Open University figures are calculated separately for each course, 
the conventional-university figures are only available for the subject 
area as a whole. Nevertheless the data in the first four columns of the table 
show clearly how in all the courses bar one, the Open University has 4 
higher fixed cost and lower variable cost than the campus university- 

: Although the data must be treated with circumspection, they do 
yield some interesting results. By comparing the two cost functions for 
different levels of student numbers, Laidlaw and Layard calculate the 
break-even number, i.e. that number of students above which total costs 


ntial. However, because of the increase 


rose, it is do i ituation 325 
regards course costs has change 7 ouk i obe 


Open University, by having suc 
its fixed costs sufficiently to pr 
be about a 4: 1 advantage ove 
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students which allows them to continue working while studying. Most 
conventional university students in contrast are full time and society 
loses the output they could be producing while studying. If these oppor- 
tunity or resource cost differences are taken into account, then the 
average cost per undergraduate difference between the two systems is 
the region of 7:1 in the Open University’s favour. A summary O 
Wagner’s 1977 figures is provided in Table 2. 


TABLE 2. Open University and conventional universities 
revised average costs 1973 (1971 £) 


ee Z Zo 


Open University Conventional university 


A. Average recurrent cost per 

equivalent undergraduate 258 
B. Average recurrent cost 

including imputed rental cost 

of capital per equivalent 


960 


undergraduate 272 LIII 
C. Average recurrent cost per 2,719 in 1973 
graduate 1,842 in the long run 4,049-4,801 
- Resource cost per equivalent 
undergraduate 


272 minimum 1,647-1,947 
— L OP NA 


enables the implications 
The cost function attem 


onwards. Otherwise it is possi 
increasing the number of new 
Thus the cost function reads 
TC =a + bCn + xCm + Sn 
where 7C = Total costs 
Cn = Number of new courses 
Cm = Number of maintained courses 
Sn = Number of students 
a  — Fixed costs 


b, x and y = Appropriate coefficients of Cn, Cm and Sn. 
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This function can now be used to assess the cost implications of alternative 
Policies. For example, in 1976 the Open University was maintaining 
Some fifty-five full-credit equivalent courses for the benefit of some 
59,000 students. Costs in future years will be determined by how many 
new courses are produced and how many new students are enrolled. It 
I5 necessary therefore to estimate the marginal costs b, x and y of respect- 
ively putting on a new course, maintaining a course and enrolling a new 
Student, all other costs being regarded as fixed. d 
Based on an investigation of Open University costs, Wagner esti- 
Mates that the appropriate coefficients in 1976 pounds are 
TC = 19,824,000 + 436,000 Cn + 44,000 Cm + 200 Sn. 
In other words, it is estimated that each new course costs £436,000 to 
Produce, each existing course costs £44,000 to maintain and each new 
Student costs £200 per annum, all other costs amounting to £19,824,000. 
Starting from this base is is possible to predict future Open Uni- 

Versity costs in the light of known plans? as well as analyse the effect of 
alternative assumptions. Table 3 provides Open University plans in 1976 
UP to 1979. It will be noted that not all new courses add to the number 

Courses which require maintaining in subsequent years as some of 
these new courses may simply be replacing existing courses. 


Taste 3. Open University Plans, 1976-79 


Student 

Year New courses Net new courses! nad numbers 
produced 
1976 55-16 50,994 
1977 3 He 62.16 56,550 
1978 2 5 72.16 Hia 
9 2,50 
79 ia 4 77-16 


k i "me 
Not including those replacing existing courses 


Con, The results of these assumptions are shown in Table 4 me a i 
the usion is that little reduction in average costs a sae 
c 1976 level of about £500 per student in the period to 19 ifia 
b 9nomy of scale reaped by the university in the earlier years a uh 
is i 4 : 1 average cost per student advantage has now stopped and 1 
in Sto be following the conventional univer 


0 Brod c. 

Uctivity, . - 
ne reason for this is that the increase 1n student — 
down. On the other hand, it may well be that a figure of about 


sity pattern of little increase 


Slowe, d 


1. ] 

These were plans in existence in 1976 and may have changed zote SRM. 
the methodology involved is useful as an example of how cost analysis can ai 
P anning. 
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TABLE 4. Open University average cost per student, 
1976-79 (1976 £ thousands) 


n-"-"-——-c——————————— ERR 


Xe Fixed New course Maintained New student Total uus 
cost costs course costs costs costs student 
1976 19,824 3,924 2,427 = 26,200 0.513 
1977 19,824 5,668 2,757 LIII 29,400 0.520 
1978 19,824 5,232 3,175 1,901 30,100 0.498 
1979 19,824 5,232 3,395 2,301 30,800 0.493 


65,000 students is the maximum the present system of production and 
administration can handle and any increase above this figure woul 
require radical reorganization and a rise in the element of cost at present 
regarded as fixed. Moreover, at the 1979 level of expenditure for course 
production and maintenance, student numbers would have to rise tO 
nearly 90,000 to bring average costs down to £400 per annum. 

The main reason that average costs show little reduction since 1976 
(and indeed since 1973) is that the Open University has been using the 
economies produced by rising student numbers to increase the number 
of courses offered rather than to reduce average costs. However, as the 
increase in student numbers flattens out in the latter part of the decade, 
the scope for using economies in this way is limited. As Table 3 indicates, 
the number of net new courses added to the programme is lanned t9 
fall significantly in 1978 and 1979. " T 
iore x nin shows, in fact, how average costs could be 

ply by increasing student numbers without increasing the 

number of new courses. If, in 1979, the planned number of students were 
presented with the 1976 number of new and maintained courses, avcra£^ 
costs would be reduced to about £450 per student 

. One limitation of the cost function is that the data are based 0” 
existing policies. In the latter part of his paper, however, Wagner c0?" 
siders the adoption of the function to study the effects of alternative 
policies. One alternative is to change the mix between different faculties 
giving greater emphasis to subjects with lower marginal costs in PI? 
duction and maintenance. For example, while ee cost 
producing a new course in the university A whole is £446,000, the cost in 
different faculties varies from £340,000 in arts to € te o in science: 
addition, science and technology students im s at F sts in the 
student-related areas because of home expe imam] Du a summe 
an. perimental kits an 

Thus in broad terms every switch from science and technology " 


arts and social Science courses is estimated to save the university at 1€ 
£200,000 in new course production cos 


and about £60 per student 
course. Wagner estimates th 


ts, £20,000 in maintenance xU 
per annum for every student taking ts 
at if all courses in 1976 had been in ? 
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and social sciences, average costs in that year would have been £426 per 
Student and not £493, producing a saving on total expenditure of 
some £3.5 million. 

, Another way to reduce costs is to change the components of the 
university’s teaching system. For example, Wagner calculates that if all 
broadcasting were removed, fixed costs would be reduced by £2 million, 
or nearly 30 per cent, and costs per course by £115,000 per new course 
and £11,500 per maintained course, a fall of some 25 per cent. If there 
had been no broadcasting in 1976, the average cost per student would 
have been £440.! Alternative options are available such as a reduction in 
P art-time tutoring or summer school attendance or a lowering of the 
polity of printing and presentation of the course materials. It is a 
Vonage argument against these options, however, that they would 
Change the nature of the product offered to the students and clearly an 

pen University operating under such circumstances would be different 
Tom the present one. 
& However, this indicates that the actual average cost-per-student 
i i at the Open University is a consequence of decisions cdam 
off university's life concerning the mix of the teaching components a? 

ers little guidance on the cost effects of alternative Open University 
oe systems in different circumstances. An Open University type tet 
fe can be made more or less expensive than the amount resu ie 
the particular production components of the existing Open Uni- 


Sandi 
=n Increasing the number of courses, broadcast programmes and 
Urs of part-time tuition will raise costs. Reducing these elements will 
iversity media mix system 


c 
ea Costs to fall. Thus the costs of an Open Universi 
all within a wide band of upper and lower limits. 
decisi he value of cost functions as shown here is that they can help: 
alters makers in the institution itself to see the cost implications "e 
he putive policies. Moreover, they indicate to outside observers not Jus 
final answers on cost comparisons but, much more valuably, the 


s 
"'Ucture of costs which produces these final answers. EL. 
uch of the writing on the effectiveness of the Open University has 

Stude Concer ned with achievements such as attracting. geogr. ed 

utiliza? differential survival rates of different categories © s A : 3 

8 tion of broadcasting, and so on. This information is on e 4 

to Mane in a paper of this nature and the interested sr s m 


be fou, tosh; Calder and Swift (1976). Other useful i 
nd in Tunstall (1974), Bates (1975)... NE " 

€ information on educational standards is more subjective but sti 
ht to maintain 


"erestino I F ity has soug 
- In general, the Open University 


pen University is in fact 
sh y 
Ould consult Bates and Kern (1977)- 
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similar academic standards to other higher education institutions through 
rigorous external assessment of their teaching materials together with the 
usual external examiner provisions. An increasing number of uni- 
versities are now willing to give exemptions to Open University students 
for credits earned and the Central Council for National Academic 
Awards has agreed national transfer arrangements between the Open 
University and Polytechnics. Many universities also now accept first- 
and upper-second-class honours Open University graduates for post- 
graduate work. ] 
There is thus firm evidence of recognition by the higher education 
system that the Open University academic standards are equal to those 
of other institutions. However, an objective measure is not yet available. 
The Esmee Fairbairn Economics Research Centre at Heriot Watt Uni- 
versity in Edinburgh in conjunction with the Open University has been 
carrying out an experiment which will shortly yield results. The exper- 
iment carried out at United Kingdom universities and reported in 
Attiyeh and Lumsden (1971) has now been extended to the. Open 
University. In this experiment, all first-year students of economics are 
given a series of multiple-choice objective questions both before an 
after their course. The resulting change in performance is standardize 
to allow for various student characteristics so as to enable some measure 
of learning gain due to the course itself to be established. The interim 
results seem to confirm the academic effectiveness of the Open University: 


Further information can be obtained from the Esmee Fairbairn Economics 
Research Centre. 


SURGE at Colorado State University 


SURGE! stands for State Universi 
and was established in 1967 by th 
State University in the United St 
employees of various corporation 
necessity of their attendin 


ty Resources for Graduate Education 
e College of Engincering of Cola 
ates to provide graduate-level pae” 
s in the state of Colorado without m 
8 the campus of the university. The y in 
expanded and by 1972/73 the university offered master degree P” 
grammes in Civil, Electrica], Mechanical and Industrial Engineering? 
and Business Administration as well as individual courses in mathematic® 
statistics, atmospheric science, psychology and watershed science. 
that year, eighty different courses were offered and these were take 


by 1,277 off-campus students from thirty-four different industrial 2” 
governmental organizations. 


ts 

The SURGE programme makes available to off-campus studere 

courses which are already in existence for campus students. This is dor; 
by video-taping a lecture plus any classroom discussion in a spec? 


1. For further discussion of SURGE, 


jo 
Baldwin et al. (1972) and Wagn: 


sec Baldwin (1969), Baldwin and Neidt (19 
er (1975). 
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equi tudi 
B ete eed classroom. The tape is packaged with class materials, 
hi ac aa examinations and collected by a commercial delivery 
siete indents ee of the same day. It is then delivered to the appro- 
sttdlente- aunt i: ocation where it is usually viewed by off-campus 
Sisko, poet orty-eight hours of theoriginallecture. During the viewing 
nr d i des uate student is usually on call at the university to deal with 
The um à e ppe students may have as they watch the material. 
fuel 46 d e held for a second viewing but eventually they are 
snt 1 s university where they are wiped and used to record 
«s ectures. Personal contact with students is maintained by 
prem Mine: to their location. 
and ee have to complete the same assignments, reports 
Wil, Ales va as on-campus, students. If there is any laboratory 
lire utin UN the facilities of their employer. When specialized reading 
a ce ex article is photocopied and sent to cach student. SURGE 
agn m the same certificate and notation as campus students 
The Inction is made between them in the records. an 
Hinton naa organizations provide the classroom facilities, 
of char £ equipment and administrative support for the programme free 
Tge to the university. All parties benefit from this arrangement. 


Ne universi B A PAR 
niversity has certain costs of the project met from outside its own 


ee the project as a whole provides an additional source of 

better u — participating organizations obtain in-service training and 

to at Ora, ifications for their employees at a lower cost than if they had 

Cations on campus, while the students themselves obtain these qualifi- 

OF ee ee having to give up their employment to attend full time 
1 large distances to study part time. 

n analysing the costs of the SURGE system, Wagner (1975) pro- 


u y 
“ced disaggregated cost functions which enabled the effect of changing 


i 
Progra variables in the system to 
uplicag s in any one year is made up 
support ng and distributing them and 
at each location. Hence, 


TG =f(RDS) 


be assessed. The total cost of the 
of the cost of recording lectures, 
providing student services and 


Wher 

© TG = Total costs 
= Recording costs 
= Duplicating costs 


Recordi = Servicing costs. 
a ing costs have a large fixed element ın that the studio-classroom 


Or k E > 
reached heavily utilized until 
there a, when a new studio-classr 

re variable costs directly relate 


uplicating and distribution costs depend on the number of locations 
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to which each hour’s worth of course material has to be sent. Each aa 
requires a separate recording because the speed of the operation oer 
allow time for copies to be made from the master tape. So a su -— 
number of recording machines must be available to cover the num cies 
locations each course is likely to be sent to. The cost of the ie i 
machines is, however, fixed in relation to the number of recording “fe of 
The other costs such as distribution depend on both the num ai 
locations (or tapes required) and the number of hours of course mater! 
roduced per annum. m 
j Finally, there are servicing costs. These consist of faculty visits ad 
students, which depend on the number of locations per cou ble 
course hours and the cost of graduate instructors’ help in being availa is 
for personal calls from o -campus locations while the students E 
watching the material. These, together with secretarial and other mi 2s 
student support expenses, can be viewed as fixed costs for cach course qe 
hese separate production, duplication, and distribution, and "al 
vicing cost functions can be brought together to calculate an ipn 
average cost per student contact hour. In 1972/73, there were 2,790 ho Ae 
of recorded material, the maximum number of locations for any ° 


m . hines 
course and therefore the maximum number of recording macl 
required was 11, the averagi 


and the average number of students 
figures to the average cost fu 
per student contact hour of 

The value of disaggreg 


classroom being used for thirty hours 2 wer 
ld not significantly affect the overall a 
à move would reduce average © 

ut $0.60. 
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TAB: i 
LE 5. Effect of varying student numbers per course 
and location per course 


e e HS MARNE RR E RR a ns 


Students 
per Locations per course 
Co 
urse 1 2 2.92! 3 4 5 
I 
" 39:78 64.23 68.32 68.68 73-13 77-58 
3 oo 9 32.12 34.16 34.94 36.57 38.79 
à 9.92 21.41 22.77 22.89 24.38 25.86 
5 14.95 16.06 17.08 17.17 18.28 19.40 
6 11.96 12.85 13.66 19.74 14.63 15.52 
7 9.96 10.71 11.39 11.45 12.19 12.93 
8 -54 9.18 9.76 9.81 10.45 11.08 
9 ura 8.03 8.54 8.59 9.14 9.70 
10 04 7314 7-59 7.63 8.13 8.62 
Ir 5.98 6.42 6.83 6.87 7.31 7.76 
12 5.43 5.84 6.21 6.24 6.65 7.05 
12,11 4-98 5.35 5.69 5.72 6.09 6.47 
13 4-94 5.30 5.64* 5.67 6.04. 6.41 
14 4-60 4-94 5.26 5.28 5.63 5.97 
15 427 4-59 4.88 491 5.22 5.54 
16 3-99 4.28 4-55 4.58 4.88 5.17 
17 3774 4.01 4.27 4-29 4-57 4.85 
18 3.52 3.78 4.02 4-04. 4-30 4.56 
3-32 3.57 2.80 3.82 4.06 4.31 


LA 
ctual numbers in 1972/73. 


Who benefi [A çP 


rough new technology are usually 
the product. Thus, if new machinery 


. The workers who have had to 
duce their number will take a 
the consumer, if he or she is 
fit through reduced prices 


chan : 
Shar, 8€ working methods and possibly re 


e 
lucky E the form of increased wages. And 
0 and there is anything left over, will bene 


"Ta mproved product. 
techno education, a similar situation exists. Given that the introduction of 
nding T reduces costs, how is this to be apportioned? There is the 
enefit, y ody the academic staff and the students, all with claims to 
M es "dea id the delicate political issues involved in such a decision, 
OWever urprising that no published study on this subject is available. 
> IM a study of the Stanford Television Service, Jamison and 


sd 
be Spelt 5 (1975) show how costs analysis enables the various options to 


ut. 
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Jamison and Lumsden use a model which takes faculty time as 
fixed. Given this constraint, they seek to establish trade-offs between 
various options open to an institution as a result of the introduction of 
new technology. These take the form of an increase in faculty research 
time, the number of courses or the number of students. In other words, 
if new technology enables more to be produced from a given input, this 
can be distributed in a number of ways. The administration might favour 
more students being taught for the same cost, thus producing greater fee 
income; the students might favour more courses being made available to 
give them more choice; while the faculty might favour student and 
course numbers remaining constant with the benefit being received by 


them in the form of less teaching and more research and consultancy 
time. 


degree courses at the 
de the cost of producing 
of producing the course 
r an element of personal 
vision factor each year 


In 1971/72, there were 597 MBA-degree students enrolled at 


Using their model amison and Lumsden 
show that if the eight most heavily attended d were taught by IT 
within the same cost constraint MBA enrol 


1 his case. However, the Stanford experiment 
and their paper offer a good example of how cost analysis can be use 
to indicate the option available. P 

Their paper also deals with the 
an evaluation of student lear 
instructional television. This 


1 effectiveness side in providing 
ning on one of the courses taught 
was the micro-economics course taken 
he alternative of attending the live lectures 
lecture on television in overflow rooms ° 
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cent attending all the lectures, 43.8 per cent never viewing lectures on 
live television and 58.4 per cent never viewing the video-tape replays. 

Numerous tests were used to measure student performance over 
the course. An objective test was given near the beginning of the course 
after they had read a programmed text, course work was handed in, 
and they received final examination scores. Using regression analysis, a 
number of interesting results emerge and are described in Jamison and 
Lumsden (1975). The major point relating to media is that ‘all methods 
of presentation of the lectures appeared to be equally effective in terms of 
learning economics’. 

Student attitudes to using media were also tested; 68.5 per cent of the 
class opted for the instructional television approach rather than the 
Conventional teaching method of other courses and this course in pre- 
vious years. 


Conclusions 


It has only been possible to review a small number of economic studies 
92 the use of media for distance learning at the post-secondary level. 
ere are now a significant number of such systems but many are of 
recent origin and have not been in operation long enough to raman 
useful studies, In other cases, studies have been mainly for interna 
Purposes and the data produced are not suitable for comparative p 
Poses. This situation should improve over the next few years uni “ os 
come more firmly established. However, 1t may be necessary i ede 
tutions and the international agencies which sponsor them to en g 
Such evaluative studies and to ensure their independence. . — 
Even from the limited number of studies available, it is po: 
draw Some conclusions. The following come to mind: on ae 
le there are common features of all media systems, pos E vitis 
education has some specific characteristics that require sep 


Costs-and-effectiveness analysis. — s bai and 

€ cost side, utilization is a crucial variable for Seta eh P. 

poet fuv eae = ana egens caca T should 

Most ca rutinized. Where possible, semis!" : 

e co. ae the effect of different utilization jacent 

While Cost estimates are an essential requirement for an ek en 

about media use, cost analysis is most panem. in — ees 
Systems already in use. The structure of cost func 


x sable 

stinction between fixed and variable costs makes them very m 

i i rses ol i 
2 i s of various alternative course: tic 

: ufi cae ne € iae tere aid to the distribution of benefits arising 

aa thee Eno ae the use of media. This is a man- 


from co ` ibutable to 
sts saving attrıbuta BA 
agement wien for educational technology similar to the problems 
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: i industrial 
facing industrial management on the FIM T : d 
technology. The general lessons of the Siria ia ds ages 
should be applied to E ee an 
further study should be encouraged. . — " 
A i-a exists in ti area of effectiveness studies Ee es of 
higher education. Most studies assume a similar stan lore bebe 
achievement between media and conventional techno n. While 
few provide objective evidence to support this — ans 
subjective evidence is crate e iens i supports 
ion, more objective evidence would be welcome. -a piget 
It is dificult to generalize about the cost effects of using un d. ier 168 
education. The media mix of Systems is different, the utiliza one 
which are very important are different, and the time n specifi- 
different. Systems cannot be picked off the shelf ere piectives> 
cally designed and costed to meet particular educational o ? m. i 
Given that and accurate utilization. estimates, media p — 
higher education can provide for a variety of educational obj 


an provide decision-makers one of 
€s and with insights into the stru 
tering, 
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Broieen as H. (ed.). Distance teaching for formal education: what the 
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Educ “bject analysis 
School on! Radio Broadcasting’s radio progr 
Preparing primary school examinations. 


ammes for adults out of 


The Onlents analysis 

of Ba ja ational Radio Broadcasting Institute (IRDEB) of the state 

catio 1 in north-east Brazil was set up in 1969 to co-ordinate edu- 

he broadcasting in the state. Since 1969 it has offered courses on 
mination, equivalent to the 


TAG 
leve] adio for the first-cycle madureza exa 
hool. IRDEB has also been 
aching programmes but the 


been for the madureza, with 


our tie final four years of primary sc 
' In a number of other distance-te 
nroj, © terms of student enrolment, has 
Progra E rising to some 8,000 students in 1977- The IRDEB madureza 
Project me has been parallel to, but separate from, the federal Minerva 
decision which has not been available to students in Bahia. The 

to run the project at a state level meant that it was possible 
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to relate the teaching material more closely to the state-set madureza 
examination. 

IRDEB students receive radio programmes, which are broadcast 
between 8 and 8.30 p.m. daily, and printed texts which support and 
relate to the broadcasts. Some students listen at home—and inevitably 
there are no figures to show how many madureza students prepare them- 
selves for the examination informally in this way—but others attend à 


listening centre where they follow the broadcasts under the guidance of 


a monitor. The number of centres has risen from 100 in 1973 tO 208 
in 1977. The monitor’s role is to act as group leader and he is provided 
with a manual giving guidance on how to run the class and answers to 
the questions posed in the students! textbook. The courses are prepared 
at IRDEB, with subject teams preparing the radio programmes, the 
printed materials and the tutor's manual together. Eight IRDEB inspec- 
tors work with the teams and also supervise the work of groups in the 
field, although in practice they make regular visits only to groups in the 
two major cities. Students pay a fee of 50 cruzeiros (slightly over U.S.89) 
per semester for cach group of subjects; the monitors arc paid at 2? 
hourly rate equivalent to the rate paid to primary school teachers mn 
the state. 

Detailed figures were not available for absentee and drop-out rates; 
but these were thought to be of the order of 2 5 per cent, taken together, a”! 
were higher in the interior than in the capital city. The national pass rate 
in the madureza examination is 33 per cent and figures for Bahia from 1973 
to 1977 appear to have been 33, 37, 24 and 21 per cent, although the last 
two figures may be underestimated. IRDEB students in one town, £C? 
Ty typical of the state, achieved a pass rate of 24 per cent which is VC? 
toa to the rate of 25 per cent achieved by students studying indepe™ 

Y, or at a private establishment. The figure is half that achiev 
by students following courses arranged by the state using face-to-face 
methods and qualified teachers. From the point of view of examination? 


therefore, the IRDEB s «ap, the 
i " System does n vith 
alternative. ot compare favourably V 


: e5 
ourses were compared with court 
vate establishments, revealing that IR 


and orthodox, face-to-face s 
costs, it would need some 100,0 i 

fi 000 students to pr init costs 51 
to those of the private establishments. dad 


Thus the scale of IRDEP's activi ro" 
$ activity wa r adureza P 
gramme did not look attractive ec y was such that its m en 


y onomically. While there may have "<; 
strong educational reas i ^ ; ; 15; 
g ons, which are not amenable to economic analys a 


for the os " have been run separately from the federal Mine le 
project, the costs of distance teaching at the level of the first 
madureza did not compare favourably with possible alternatives. 


mila" 
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Origin 
Brazil. 
Authors 
OLIVERA, J. B.; Onivzz, F. 
Title 
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Bibliographical description : 
Perraron, H (ed.). stance teaching for formal education: vhat id 
Projects tell us about cost and effects. Washington, D.C., Woa o : 
September 1978. (Mimeo. Prepared by International Extension College 
for the World Bank.) 
Subject analysi. E 
Bud EE radio programme for adults out of school preparing 
Primary or secondary school examinations. 
Content analysis ; : i 
his study is part of a series of three studies on madureza p ‘Bod B = 
‘Ponsored by the World Bank. The word madureza refers both to a pre- 
Paratory course and to an equivalence examination. earn rd 
Blves an equivalence diploma to either primary, basic is seco imd ss 
Che Concept of the course and of the examination has been = r " 
“me, but, as an institution, it was originated in the e canona system 
n s is usual in developing countries, the Brazilian e E mU qu 
Is c aracterized by very substantial rates of iow d qm uude 
“normous inefficiencies. A cohort of students entering x a m finishing 
Primary school in 1g61 would show only sixty-four of the 
“condary school twelve years later. 3 : es in 
Oreover, rofund amid transformations and i dits 
aracteristics of the work market caused aa ant robuitud: 
economy. besides the process of urbanization, have contribute 
the Value of education and of school certification. = 
In the late 1960s, demand for school opportuniti As a part of the 
Very substantial rate, and pressures were felt all over. P 


: i idea of 
m veral governmental efforts in education and schooling, the i 


i da 
mad A in priori ass media have playe 
or to 5 received a certain priorij sain cerned, the govern- 


maior Tole. As far as legislation and regulation are con omivat 
" mt has Passed a decree according to which all of the pss fem ia 
a ds radio and television stations in the entire comar us m Ups 
been t five hours per week of free broadcasting. Most o i pe ete 
cen used for the Minerva project, both for madureza ani 


adult 
<cucation programmes. h duction 
. : i t encompasses the prodi > 
broa The Minerva project starded in 1970. Tt ed miae of radio pro- 


Oadcasti : for the organiz 
Sram p ee of the eight years of funda- 
mental o antie 1096] ofthe last dou" grag tae programme, financed 


al educati Minerva is a feder ; 
ang managed by ihe MINE of Education, it is only responsible es 
Prog Ction an d. delivery of the course: it was not responsible for the 


the ch 


es were increasing at 
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organization of reception classes nor for the examinations, which are à 
privilege of each state, according to the legislation. However, through 
funds and technical assistance, Minerva has helped some states to set UP 
their own reception systems, as well as their examination procedures. 

The potential clientele for Minerva can be estimated in millions, but 
the actual intended clientele organized and managed by local efforts ofthe 
various states has been estimated at about 142,000 students. So far, 
Minerva has been repeated three times, over a period of twenty months 
cach, and it has reached about 300,000 students under organized recep- 
tion. No reliable data are available for free reception, but since the 
programme was simultaneously broadcast throughout the country; 
it is possible that many more participants have benefited from the 
broadcasts. 

The paper describes the production, broadcasting, reception and 
evaluation procedures used by the project, as well as its complicated 
co-ordinating activities. Since states are responsible for both implementa" 
tion and examinations, and since many other forms of schooling are avail- 
able, very few data are available in terms of the effectiveness of MinerV?» 
ie. how well Minerva students perform the madureza examinations. In 
some states, specially prepared tests for Minerva students have been used. 
Overall, the scarce data available are slightly favourable to the project s 
compared with the national averages. However, these data cannot 
interpreted as a definitive conclusion, given their doubtful origins and the 


aggregate nature of the national averages. There are also no backgrou” 
data on students. 


As far as other results are concerned, Minerva has produced 
anp of instructional material, and over 400,000 series of workbo? s 
tot ee me stil sore throughout the country. The log i 
is also quite inqui udent workbooks and tapes to the radio st 

t As far as costs are concerned some analyses were made from the dat^ 
available. Specific difficulties in data collection are referred to i? Led 
paper, since the project was part of an agency which had other activitic* 
and the budget was not separated by functions. Within these constraint 
costs have been computed in terms of production broadcasting and recep" 
tion. Assumptions had to be made referring to the cost of broadcast? d 
by the private stations. Costs have also been computed for the print’ 
materials and general administration, both in Teena 0f capital and exP. d 


ditures. For 1977, the uni ^ jn 
5 > t cost was estimated Á mpa” 

‘os, comp 
to an average of 400 cruzeiros for oth E Nees the 


à 5 ‘ er types of madureza courses, a” 
rigs — RN printed materials or books for the students. The se 
Mice vetere yield very attractive average costs: going pen 
y b Students, the average c er € 
: ` ost goes down 56 P e 
It was estimated that if the system could teach 500,000 with the sam 
cost structure, the average cost woul i i 


gt 
d additio 
25 per cent. go down only an 
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Lack of data and of other studies makes it still premature to for- 
mulate judgements on Minerva’s worth. It is undoubtedly a gigantic 
Project, with unique characteristics and problems. Inefficiencies such as 
the utilization of 1,100 radio stations and the inadequate controls of 
reception are easy to detect: alternatives and solutions, within the socio- 
Political context, are not so easy to find and implement. Issues such as 
centralization versus decentralization of production and implementation 
are also discussed, and the authors conclude the article with some general 
lessons which can be drawn from the project, in terms of tele-education 
Policy-making using large-scale experiments. . 

. This paper will be published in the forthcoming book, The Cost of 
Distance Learning, edited by Hilary Perraton, International Extension 
College, 131 Hills Road, Cambridge CBe 1PD, United Kingdom. A 
Portuguese version can be obtained from ABT, Av. Erasmo Braga, 
255/401, Rio de Janeiro, RJ, Brazil. 
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he appropriate usc o 


n i . H 
“inforce and extend the efforts of extensionists T e Ts Hast 
; HET a i -cost solution to this dilemma. 

V: t least a partial, low-co: lied aper- 


; age Education Project (BVE) has been a carefully contro x dt 
mi to study the effectiveness and relative costs of various com 
tons media combinations utilized in such a manner. ; 
he Basic Village Education Project comprised a carefu y a 
tigor non-formal education programme not a arg di — inda 
leo ous independent evaluation of that popan s na = sen e A 


and mary audience was the small, often illiterate, i asp d 
i i ion to help tha 
farme, Programme content concentrated on informatio p t 


T improve his production and profits from basic crops. 
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The project design (as modified in 1975) included four communi- 
cations media combinations as variables, with radio being a common 
element in three of those combinations. The variables, or treatments, 
were: . : m 
Treatment R (Radio). Educational messages were conveyed to the targ 

population only through mass media, principally radio. : 

Treatment RM | ( Radio-Monitor) added interpersonal contact to d 
media delivery, achieved through a local person (monitor) employe 
and trained by the project to work directly with farmers in his own 
and three or four near-by communities. 

Treatment RMA (Radio-Monitor-Agronomist), the most intensive treatment, 
included mass media and monitor as described above, and intro- 
duced a low level of technical agronomic assistance. he 

Treatment M (Monitor only), added in 1975 to ascertain the effect ete 
monitor apart from that of radio, utilized a monitor working in * 
area where the BVE radio signal was not received. 

Matched experimental and control areas were established in cach of the 

two regions specified in the implementation plan. 


The BVE Educational Programme. Initiation of educational programming 
in the Oriente coincided with inauguration of the BVE radio gatio 
Radio Quezada Educativa, in late March 1974, following about n" 
months of intensive planning and preparation. Most operational Ph é 
sonnel were provided by the Government of Guatemala, principally $ 
Ministry of Education which administered the project. 


An integrated four-component educational programming syst 
was instituted to facilitate the development of a quality programme. " 
components—message development, educational materials producto g 
delivery to the target population, and formative evaluation—were ett g 
means unique to BVE. The key to the project’s success in programm" a 
was the manner in which they were co-ordinated and integrated into 
functional system. 


«ned 
Primary responsibility for agricultural tent was assign¢ 
to the BVE technical agriculture section wht een 


feed ‘al agriculture section which sought out, assessce g 
organized information from three kinds of sources: the people to wh hi 
the message would be directed; institutions which generate new ens 
nology and information; and institutions which provide farmers we "s 
needed goods and services. The Ministry of Agriculture was the projed 
primary source of technical information on agriculture, and reviewed a e 
approved all technical content prior to its use in the BVE program r0" 

The project produced both materials needed in the internal ring 
gramming process, and audio and graphic materials for use in deliv the 
its message to the target audience. The production output of B fort ng 
Oriente included a book of technical message content with accompany ye 
scriptwriter’s guide, annual message calendars and bi-weekly rt 
strategies for nearly three years of educational programming, more ' 
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one copies of 933 different graphic materials, and 6,872 different 
programmes of various types. 
live Si eran Educativa broadcasts a mix of pre-recorded and 
related E De (about 20 per cent was educational programming 
Pl NI ture) to Oriente families throughout the period of the 
split m acea sation was on the air from Monday to Saturday on a 
Siiniaiued € (05.00 to 09.00 h and 16.00 to 20.00 h). It captured and 
Seo A a large listening audience in the BVE experimental areas 
[wa to the results of periodic listener surveys. 
dies hera BVE monitor was assigned to an area of four or five communi- 
WES ane I e 250 farm families per arca depending upon community 
‘eo “re ility, and natural geographic or social limits. Nearly 
16,506 y farmer meetings (radio forums) with a total attendance of 
experim ults were held by Oriente monitors during the course of the 
ent in addition to their contacts with individual farmers in their 


assigned communities. 
field Ee to the relatively small size of the R 
Rr aa worked only part time in each. [ 
families p basis, he was responsible for an area having about 600 farm 
ment. cr is principal functions 1n that arca included monitor reinforce- 
and feedba demonstrations and related activities, problem identification, 
laon back. He also served as monitor trainer and supervisor, provided 
ann with other agricultural programmes 1n the region, supplied local 
ews to Radio Quezada Educativa, and participated in the devel- 


bis 3 of technical message content. 
E il nemi information feedback sys 
tively a d $ continuing success. Various m 
tom m ormative evaluation, were utilized: weckly feed-back reports 
Onitors and field agronomist; testing of newly developed pro- 


Sram 1 x 
me materials; letters received by Radio Quezada Educativa (70,000 


duri 
n 3 : " ` : 
Siu the course of the experiment); listenership surveys; and radio 


ihe : de eae tests. In addition to helping the programme re: 
Contrib er-changing interests and needs of its audience, such feedback 
uted to the interpretation of summative evaluation results. 
develo small unit was established in late 1975 to concentrate on the 
tieu], ent and field evaluation of new programme materials, par- 
Y graphics. Its output (field-tested in both the Oriente and 


cci 

Bae te regions) included four picture booklets with simple tests, two 
Specia] and-out combinations designed for mass distribution, eight 
ang Posters and hand-outs for use in radio forums, and seven posters 
disaster zone following the 


Six iai * A 
1976 teen flyers for distribution 1n the 


carthquake. 
and adjustments was required 


due ', Pumber of in-course modifications 
and agricultural/climatic factors 


MA treatment areas, the 
Expressed on a full-time 


tem was indispensable to the 
echanisms, considered collec- 


t ap 
beyond administrative, operational, 
lems wi the control of the project. Delays in delivery and technical prob- 
hortfalls on the part of the 


ith equipment, budgetary delays and s 
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Government of Guatemala, drought, and a disastrous edes es 
among the most important. In general, however, project op ee 
adhered to the implementation plan throughout the course 
oe ais of project costs, cost effectiveness and benefit/cost ag 
ships has not yet been completed. Early approximations indica’ ane 
ever, that the costs in 1975 for operation of regional programme Mrs 
on the projects R, RM, and RMA treatments (expressed X ien 
farmer-reached basis) would have been $4.34, $21.25, and $31. 
ectively. u 
i ^uis MN programming in the Oriente region was terminated 
on schedule at the end of 1976. The Ministry of Education rie 
complete responsibility for the BVE educational programme 1n 


e. x B . H " mmc 
region as of January 1977, and it is continuing as an ongoing progra 
of that ministry. 


. s 
The BVE evaluation findings. An accurate measure of the BVE impact We 
obtained through the continual evaluation which was a charactors S jy 
the project. It started with a baseline study, continued with a 
time sample studies, and ended cach year with an annual survey- t also 
ation activities were guided by a rigorous experimental design, bu 
took into account social and political realities, . ivities 
Joint planning of the field programme and the evaluation puni 
from the earliest stages of th both 
the accuracy of results obt tion- 
ion but allowed for continuing co-ordina 
The evaluation data provi 
initiators and feedback 
activities served two pur 
programme feedback. 
The BVE educational programme hai 
measurement of chan 
twenty-nine agricult 
BVE effect when tre 


he 
— ENS eT 
d a significant positive iph ng o! 
ge through a total practice index peque 
ural practices revealed evidence of an 


H n a no 1 
1.€. monitor or monitor and a8 hclminé 
5, radio continued to be the overwhe ^... 


te. 
ae m of knowledge, attitudes and prae dio 
'The impact of radio diminished over time. In the early stages» info?" 
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important at the second stage of diffusion. Radio also showed a 
decrease over time when combined with other media such as monitors 
or visits of the agronomist which were reported as increasingly 
important sources. 

Efforts at personalizing radio, a traditionally non-personal medium, were 
clearly among the most important factors in the success of BVE. The 
Project used a unique system of personalizing the radio message 
programming which involved a feedback system with letters and 
reports by the monitors and agronomists. This type of ‘open’ system 
allowed the people themselves to develop a dialogue and assist in 
message development. 

* monitor proved to have an important impact on change. In the 
area where the monitor served alone, there was evidence of rapid 
change in the second year of programming. When combined with 
radio, the monitor did not reach the level of radio as a source ofnew 
information, However, the monitor’s impact increased continually 

C Whereas that of the radio declined after two years of programming. 

?mbining radio and monitor did not appear to increase total impact. 
Further investigation of community structure wil be necessary 
before any definitive conclusions can be drawn regarding the lesser 
effect of the combination of radio and monitor in comparison to the 

lis vonitor alone or radio alone. . E 

Verall impact (in terms of change) was greatest 1n those areas in 
Which the agronomist was used in combination with radio and 


Inonitor, The agronomist was seldom mentioned as a source of new 
nation of responses related 


Information for change. However, exami : : 
to the question ‘Where do you receive good information for your 
agricultural operations?’ revealed frequent mention ofan agronomist, 
including the BVE agronomist. Since many of the agronomist’s 
activities are back-up rather than direct contact, 1t was not totally 
Unexpected that the agronomist was not mentioned more often as a 


Principal i ion for change. 
source of information for change. — 
ne 2 clear indication that uncon- 


"BC observed in the control area is a 
‘rolled sisted in the field. Such factors 
*d or uncontrollable factors exis ip dee eai 


ad to be taken into account when measuring t 


UE 3 
Dig, BVE in the treatment areas. —m T 


ntial treatment effectiveness was pre 
B * project. Differences were found that substantiated a a 
VE effect on the experimental areas when compared to natura 
change in a control area, but change between different experimental 
Ini; Seas wa é in favour of any one treatment. 
it s not consistently in fav 
sally, the design was seen A composed of four discrete treatments and 


feren b with the treatments designed to be independent tests of dif- 

edia approached. As the project evolved, however, the assump- 
tha, % Independence became increasingly questionable. It seems clear 
the creation of a powerful message development and feedback 
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system resulted in the specific media delivery system being of = 
importance, and hence not creating change independent of the mesai 
The agronomist and monitor were necessary for message developm: i 
and feedback used in all treatments, as well as for the interpersona 
contact called for in treatments M, RM, and RMA. D. -— 

In summary, BVE evaluation findings indicate that radio is a v4 
effective change medium when used in combination with a hig T 
developed message preparation and feedback system. A message E 
entation system requires feedback from content specialists in regu! 
contact with the target population depending on content, i.c. agronomis : 
health specialist. Radio may be a personalized medium under appro 
priate conditions of content preparation. 


Origin 
Israel. 

Authors 
MELMED, A.; ELLENBOGEN, B.; Jamison, D.; Turniansky, U. 

Title 
Everyman University in Israel: The First Two Y; ears. 

Bibliographical description he 
Perraton, H. (ed.). Distance teaching for formal education: what t k 
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e 
September 1978. (Mimeo. Prepared by International Extension Colleg 
for the World Bank.) 


Subject analysis 
Distance education at 
television. 

Content analysis 
Everyman University of Israel enrolled i 
modelled on the British 


ý d 
post-secondary level supported by radio an 


was 
poth 


5 : ers) 
§ to expand tertiary education. The uy pic 
ocial 


from 
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courses. In practice 80 per cent of the students enrol for the more pres- 
ügious degree courses. The same method of study is used for all three 
types of courses. The main burden of teaching is carried by correspon- 
dence lessons, planned by the university, but written partly by full-time 
university staff and partly by consultants from other universities in Israel. 
The correspondence lessons are supported by radio and television pro- 
grammes. Students can, if they wish, work entirely by using correspon- 
dence lessons and broadcasts but study centres are also provided at which 
they can get tutorial help. Not every study centre can provide tutorial 
help for every course. Students are evaluated by a process of continuous 
assessment as they work through their correspondence assignments and 
by course examinations. Students are expected to work from twelve to 
fifteen hours a week. The university works on an eighteen-week cycle, 
with two cycles a year. Students who have successfully completed their 
first course may then do one or two courses in each cycle. 

Everyman University enrolled 2,200 students in its first cycle of aca- 
demic courses in 1976 and enrolled 6,200 in its fourth cycle. It plans to 
Produce some 750 graduates each year but its exact relationship with the 
Test of the Israeli system of higher education is still to be worked out and 


depends on two awaited decisions. The first concerns accreditation as, atthe 
üme of writing, the degree had not yet been accredited in the same way 
as those of the other universities. Second, arrangements had yet to be made 
Or government to take over financing from the Rothschild Foundation. 


The university has had some success in making wider educational 
?PPortunities available to Israelis from Africa and Asia. Students born 
In África or Asia (excluding Israel) or whose fathers were born there, 


°rmed about 20 per cent of the enrolments in the first three cycles of 


academic courses as compared with figures of around 14 per cent at 
4. It is more difficult to make 


ordi RUE : 
larg universities over the period 1969-7. 1 
™ Statements about its costs per graduate at this early stage. In par- 


petlar, it is too carly to consider how far costs per graduate are likely to 
"s affected by drop-out rates. If, however, the university reaches X 
tane of producing some 750 graduates a year—which seems a eee 
with e then the authors conclude that the cost of producing a gra a 
. | * first degree would be some U.S.$5,600 at 1977 prices compare! 


Wi s Ó 
SUN Cost at an ordinary full-time university of some U.S.$11,000. If the 


o : m 
PPortunity cost of students’ time is also included, then the compart 


ŝon is even more favourable to Everyman University. — 
meth hus, the university’s early results suggests that c e es 
fates can be used effectively and economically at this level of e 
tech n. Success does, of course, depend on the existence of an appropriate 
tor end and educational infrastructure, so that the university can make 
Bo efficient use of existing educational facilities. At tertiary level, the 
ins regular education is so high that it is possible for a distance- 
lowe ing alternative to produce satisfactory financial results at a much 
T level of enrolment than is necessary at lower levels of education. 


-teaching 
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Origin 
Kenya 
Authors 
Hawxnrpcz, D.; Kinyanjur, P.; Nxmvyanct, J.; Oriver, F. 
Title 


In-service Teacher Education in Kenya 

Bibliographical description 
Perraton, H. (ed.). Distance teaching for formal education: what the 
projects tell us about cost and effects. Washington, D.C., World Bank, 


September 1978. (Mimeo. Prepared by International Extension College 
for the World Bank.) 


Subject analysis 
Correspondence courses for in-service teacher education supported 
by video. 

Content analysis 
The Correspondence Course Unit (CCU) of Kenya was set up as part di 
the university's Institute of Adult Education in 1967. Its main function 
was to provide in-service training for primary-school teachers. : 

As in many countries of the Third World, the demand for education 
grew rapidly in Kenya after independence and the number of childre? 
in primary school doubled in twelve years. It was not possible for the 
orthodox, pre-service, training colleges to produce trained primary 
school teachers to meet the demand for trained teachers. In 1964 the 
Kenyan Government therefore began to explore the idea of using corre 
spondence and radio to train unqualified and underqualified teachers: 
USAID provided finance for the project and arranged for a team from t 
University of Wisconsin to help in setting it up. 

The unit has now been working for ten years and offers course 


the major school subjects. each consistin: ments: (a) t€ : 
J > ing of four ele : ( ) 

hi } : . biects; b 
which are the ae school textbooks in the appropriate subj A M 


additional explanati 
by the isolated student at home; 


s in 


: he 
(c) radio programmes, produced at t e 
the cor” 


" 8 E cn 
oks; (d) work assignments, which the stu o 
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Between 1969 and 1974, some 8,400 students followed the course for 
unqualified teachers. For the most part these were older than students on 
the KJSE programme and had at least four years of teaching experience. 
A total of 7,600 of these worked through their course, completed two- 
thirds of the assignments set them and qualified for promotion. In 1974, 
the programme for unqualified teachers came to an end, in part becausc 
there were then far fewer teachers whose limited basic education fitted 
them for that course. The other programme, for KJSE, continued; but 
this had always been, and remained, a smaller programme than that for 
unqualified teachers. Over ten years, some 4,200 teachers and a small 
number of non-teachers enrolled for the KJSE programme, with an 
average of 420 enrolments a year. 

Comparisons of both costs and effe 
Courses and those of the regular system arc difficult. The high cost of the 
United States aid to the programme (some $500,000 between 1967 and 
1970 for American specialists) made the costs higher than they would have 

cen without heavy foreign cost components. But even when that factor is 
taken into account, by considering the costs of American participation at 
<enyan, instead of American, rates, the cost per student remained rela- 
tively high. The cost per subject-enrolment by correspondence proved to 


be three times as high as the comparable cost at a self-help, harambee 
s to be that the number 


School. The reason for these high figures appear numl 
of students using the CCU system is too small for the necessarily high 
xed costs, especially now that the programme for unqualified teachers 
as been closed down. On the other hand, the programme does seem to 
have been successful in its main objective of providing in-service edu- 
Cation for teachers: teachers have been able to benefit from the opportunity 


9r education leading to higher qualifications and to do so without leaving 
their schools. 


ctiveness between the CCU 


Origin 
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L Authors 
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Pr RRATON, H. (ed.) Distance teac 
jects tell us about cost and effe € / 
for ember 1978. (Mimeo. Prepared by International Extensio: 
T the World Bank.) 
C Subject analysis 
n «erespondence courses at high school level supported by radio for young 
Ople and adults out of school. 


hing for formal education: what the 


cts. Washington, D.C., World Bank, 
n College 
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fontent analysis . "— 

The ris bendum High School (A HS} m ete tire a ne 
in I by the Korean Educational Deve 

Maritus i Mere uo courses for young people and au is 
of school. Primary education, up to the age of 11, is compu p hr 
Republic of Korea; beyond that 80 per cent of the age So g ong 
middle school for three years but only 50 per cent go on to "aia c 
Many of the others start work but wish to continue with their c ies 
on a part-time basis and it was to meet their needs that ACHS was orca 
It offers courses using correspondence, radio, and fortnightly face-t <a 
sessions which lead to the same examinations as those taken m re ES 
high schools. By 1977, the school had enrolled nearly 10,000 stu - E 
the first of its three grades, 85 per cent of them being between the 
of 15 and 23. — 
Saden follow a programme of courses in up to fourteen sha a 
When students have enrolled and paid the appropriate fee, they scan 
textbook for each subject taken. The textbook is based upon the "e Eds 
textbook used in ordinary secondary schools but expanded to m aU 
additional explanations and tutorial guidance. It thus takes the piac 


Bip "b there 
both a textbook and a correspondence lesson. Within the textbook the! 
are exercises for students to do and 


fact, few of them make use of this se 
students are required to attend a teac 
These sessions are staffed by teachers 
overtime for their Sunday work. Th 
compulsory since, unless a student a 
80 on to the next grade at the end 


ar. 
broadcast daily, six days a week, for all fifty-two weeks of the y 


HA Ë oad- 
Because of the pressure of ar-time (and the failure of attempts to broat 
cast from tethered balloons) 


the morning or late at nigh adio 
work four hours each evening; they must also make notes on the T 
programmes, and these notes a. 
least five times each semester, 
written assignments as they w 
books, and two examinations, 
and one set and marked by th 


group (less than 1 per cent) est 
the greater part of the costs of ACH o who 
tate funds. But for thos 


f 
o! 
n 

do enrol, the results appear to be remarkably successful: 46 per C° 
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the 5,800 students enrolling for the first year in 1974 graduated in 1977, 
and a number of those who did not graduate then were expected to do 
So in later years. These part-time students achieved the equivalent of high 
school graduation, on a part-time basis, as quickly as students in full-time 
school, although at the cost of an extremely heavy burden of work. Tests 
comparing the performance of ACHS students with that of students at 
regular high schools also show that the differences between full-time and 
part-time students decline as the latter work through their ACHS courses. 
Students starting at an educational disadvantage were doing something 
to catch up with their more fortunate brothers, who could afford to go to 
a regular school. 

Comparisons of the costs of ACHS and regular high schools show 
that the cost per enrolled student, or the cost per student promoted to the 
next year, are much lower for ACHS students. In 1976/77 the unit recur- 
Tent cost for an ACHS student was less than one-third of the cost for a 
regular high school student. Analysis shows that the expected rate of 
return for ACHS would similarly be higher than for regular high school 
Students. The teaching methods developed by ACHS do therefore seem 
to be remarkably effective, as well as cheap, for this particular group of 


highly motivated students. 


Origin 
Mauritius, 
Author 
Opps, T. 
Title 
The soe College of the Air. 
tbliographà iption ~ 
ERRATON, B (e) Dei teaching for formal education: what the 
Projects tel] us about cost and effects. Washington, D.C., World uei 
Re tember 1978. (Mimeo. Prepared by International Extension College 
Or the World Bank.) 
Ed Subject analysis 
mud tional television and rai 
n in schools. 
onte; i. i 
ahe deere CHINE of the Air (MCA) was set up in 1972 by the 
—OVernment of Mauritius with the International Extension College. Its 
intention was to use distance teaching methods to improve and extend 
given to the improvement 


Ucation within Mauritius with top priority c : 
already has near universal primary 


dio to improve quality of secondary edu- 


Se 
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charitable private schools but over 30 per cent went to private eie pd 
schools which had mushroomed as a result of the unsatisfied pec ar ec 
secondary education. Thus Mauritian secondary education. = ae 
nated by private secondary schools; their teaching was often ina pe poe 
offered by untrained teachers who themselves had had no more T 
a secondary education, and supplemented by an entrenched system : 
private tuition. Most children who hoped to pass their secondary apos 
inations also received private tuition, generally offered by their ow 
teachers but in their spare time and at an additional fee. The Mauritian 
Government was interested in using distance-teaching methods to improve 
the quality of education in the private schools, and saw this as a higper 
priority than extending education to the other 50 per cent of the ag 
group outside school altogether. d 
The Mauritius College of the Air therefore developed a system of us 
tance education designed to be used within classes, under the supervision 
of the existing, though untrained, teachers. MCA employed Tescher 
some full time and some part time, to write correspondence courses whic 
would be studied in school, under the guidance of the regular ga 
Broadcasting time on radio and television was readily available and Ei 
broadcasting network covered the whole island. Radio and televisio’ 
broadcasts were produced by MCA to supplement the printed "€ 
These included exercises for students which, instead of being returned 
a correspondence tutor, were marked by classroom teachers. MCA’s st@ 3 
ran seminars for teachers working with its courses and arranged a ven 
gramme of visits to schools in order to guide teachers in the use of 
materials. Thus the teaching system was one which gave fairly fir 


i s ine 
guidance and control to classroom teachers but, with an untram 


: . ss 
teaching force, this arrangement seems to have been accepted at cla 
room level. 


available to their students. 
Since the MCA courses were 


to the 
developed as a su plement d 
Te: 3 P P y 
existing secondary schools, their co 


[S ea 
sts are additional to those aln 
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being i " 
bie: depen ue Lig cost for cach. MCA course varied, with those which 
sid n ee supervision by MCA staff costing more than 
aA, 3 ie 4 "rs heavily on print and broadcasts by themselves. 
bu i ism iod from 1973 to 1976 showed that the cost per student 
M ubere an s economies of scale at around 5,000 student 
the MCA a year; at the level at which the college was working in 1976, 
che et coms roughly doubled the cost per subject per student within 
as ES sector. If student enrolments had reached 20,000 (instead of 
eld = : 124000); the add-on costs of MCA courses would have been 
i oy 2 the comparable school fees. The add-on costs of MCA 
titan p however, compare very favourably with the costs of private 
, accepted in practice as an add-on cost by many parents. Thus the 


carl i : . 8 
ek) evidence is that distance-teaching methods, although increasing the 
of regular private schooling, could improve the quality of secondary 
ith the cost of using 


educati pa 
cation and do so at a cost comparing favourably wi 


riv Sm s : ; 
Private tuition, the alternative supplement to inadequate teaching. 
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eman dis 1976, Stanford, Calif., Stanfor 
red Studies in the Social Sciences, 
Tea ian analysis 
aching of mathematics via ra 


ppes, P. The Radio Mathematics Project: 
d University, Institute for Math- 


IMSSS, 1978. 


dio in elementary schools in Nicaragua. 


sored researchers and mathematics 


Curri, þa $ z : 
culum specialists began working with Nicaraguan counterparts in 
mmes to teach elementary school 


m; à . 
Mathematics, The Radio Mathematics Project (RMP) is now completing 
ly 600 first-grade students on an 


6, programming was extended through 


ex : 
Perimental basis, During 197 e e CAE: i 
ed evaluation of a large-scale 


th 

impo grade, and a carefully control 

Prese mentation of the 

bishe plans call for continued exp 
r grade levels and for implemen 


hrou 
ghout Nicaragua. 
curriculum is a series of 176 one-hour 


mag € basic format of the 
matics lessons. Each lesson consists of thirty minutes of radio 
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(approximately twenty minutes of mathematics teaching and the remainder 
for announcements and entertainment) and thirty minutes of teacher 
instruction (approximately seventeen minutes of direct instruction). 
Some of the general findings emerging from the first-year evaluation 
are as follows: 
1. Students in experimental classrooms achieved higher scores than 
those in traditional classrooms on all topics taught by project lessons. 
The differences ranged from 5 to 24 percentage points. The tra- 
ditional students attained higher scores for two of the threc remaining 
topics, but neither group performed acceptably. 
2. There was an initial underestimate of the general knowledge of 
Nicaraguan children. Their performance in tests on initial school 
entry was considerably higher than anticipated. Some of this per- 
formance may well be a reflection of the revolutionary role the 
transistor radio has played in developing countries, Massive radio 
communication networks are in place virtually throughout the worl 
and we know little about their effects on the knowledge and expert 
ence of young children. 
On the other hand, there was a tendency to overestimate the formal 
skills of the children on entry into school. The experience of both 
underestimating general knowledge and overestimating formal skills 
may be a common tendency in appraising students from rur? 
backgrounds in many parts of the world. 
4. Surprisingly, significant differences in performance between rural 
and urban children were absent from the data. It would be desirable 


ro know to what extent this conclusion holds for more remote rur? 
populations in Ni 


Second, the present 
training, and student work 


igb, 
nt hour. These cost ionally 18 
: s are exception 
suggesting the value of continued, careful ex ee with owe! 
levels of supervision p 8 


s jte 
duce substantially the recep Wet if 
osts over a large audience. Eve 
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this were to be done, the project is apt to remain somewhat expensive b 

the standards of instructional radio projects. For this reason, princi, a 
emphasis in evaluation of the RMP must be placed on its ana qo 
improve the effectiveness of instruction, as indicated by its effects on 
mathematics achievement test scores and student repetition rates. It is 
too carly in the project to assess its performance in these terms. 


Reports of meetings 


Summary report of the Conference 
on Economic Analysis of Educational Media, 


Washington, D.C., 2-4 March 1977 


Rapporteurs: S. J. Klees, F. Orivel and S. J. Wells 


I Introduction 


nd discussed 


Thi ome r ‘ 
is report is intended as a summary of the issues raised a 
se issues and 


hs conference. We have attempted to outline briefly the 
of th ate some of the different arguments that were advanced. For most 
nbn ese issues we have derived recommendations for future efforts in the 
inati of economic analysis of instructional technology, based on an exam- 
ion of what was said and implied in the conference discussions. 
= We have produced this report from notes taken by each of the 
ime ee It is not simply a chronology of conference discussions, but 
the er an attempt to synthesize, inarelatively cohesive, organized fashion, 
abi main points discussed in the three-day period. In the interests of read- 
ity, we have not attributed remarks to specific conference participants. 
The conference had few presentations and the number of partici- 
pants was kept small in order to foster maximum interaction and, at least 
this respect, the conference seemed successful. The difficulties in 
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organizing the wide ranging debates and discussions that took place are 
considerable. We have chosen to group the issues by their centrality to 
three different, yet quite interrelated, processes: the analytic process, the 
education process, and the decision process. . . 
The analytic process refers to the more general and technical dis- 
cussions of the approach to, and limits of, the traditional techniques ef 
economists as regards cost, cost effectiveness, and cost-benefit analysis. 
The issues we discuss under the heading of the educational process are 
those most pertinent to the application of economic analysis to the cvalu- 
ation of educational strategies that involve the use of non-traditional 
technologies. In the section on the decision process, we examine the 
interaction of the economists’ analysis with decision-makers and decision 


situations, including questions of the dissemination of economic analysis 
skills and results. Clearly these a 


it is hoped that the categorization will 


II The analytic process 


Cost analysis 


For a background on cost anal 


. rence 
und ysis, the conference had four referent 
documents at its disposal: the fi 


rst two are included in the Unesco pub- 


; by J. C. Eicher, and the conclusions of the 


: (June 1975), by F. Orivel, The third was the 
work of D. Jamison, S. Klees and S. Wells, Cost pb; for Educational 


1. The terms ‘economist? and * 
to the particular framework 
which is most widely used, 
and in some of the con: 
economic frameworks, 
ined in any depth. 


. H i e 
b eere analysis’ will generally be used in sos jos 
91 neo-classical, competitive market theory eco ee 
Although there v Ti i i f othe 
ference papers 


such as Marxist theory, these alternatives were nO 
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The conference discussions on cost analysis centred around two 
points that were examined at greater length in the documents above: 
(a) the various possible classifications of costs, and (b) the nature of the 
cost analysis to be undertaken. 


Cost classification 
In some of the background papers for the conference, distinctions were 
made between accounting, technical, financial and economic classifi- 
cations of costs. In general, participants considered that accounting 
classifications, as now practised, were of little utility for the types of cost 
questions economists ask. Such a judgement reflects, in part, the wide 
variety in accounting practices within and between nations but, more 
fundamentally, it reflects the lack of economic notions of social resource 
use and value in most accounting cost treatments. At the same time, it 
was recognized that budgetary accounting data are often the chief 
available source from which to conduct cost analysis. Hence, closer 
contact between economists and accountants was felt to be useful in the 
design of cost information systems that could enable such data to mect a 
wide range of management needs. . i 

A technical classification for costing educational media alternatives 
that relies on distinguishing central administration, production, trans- 
mission and reception system cost components was generally seen as 
quite useful for facilitating analysis, comparisons and decision-making. 

here is some discussion in certain of the background papers as to the 
utility of providing a separate category for initial conception or start-up 
costs, but this received no attention in the conference proceedings. 
Orivel’s paper recommends that such costs be included within the above 
Categories, if at all possible, and we consider such a policy sensible. 

A financial classification that breaks down costs according to the 
Various groups that are incurring them was uniformly agreed upon as a 
valuable and even necessary aspect of cost analysis. In the past, serious 
efforts toward this end have been few, perhaps reflecting the tendency of 
the traditional economist framework to view total societal costs as the 
Main criterion for efficiency. However, as more attention is paid to social 
€quity, and as some view the dichotomy between system efficiency and 
Equity as less than clear-cut, concerns with who is paying for the system 


(as well as who is benefiting) become much more important ^ ^, 
conference of economists, 1t 1s 


available resources for alternative en 1 D 
Ception of costs is seen to be a national or global social valuation measure 


most appropriate to social decision-making. The real relevance of total 
Social costs to decision-making at different levels in different positions 
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was recognized as problematic although most felt that decision-making 
incentives need to be structured so as to force decision-makers at least to 
consider the broadest picture. Such decisions should include the monetary 
or opportunity costs associated with those resources used that were not 
paid for from the particular decision-maker’s budget. We will discuss 
some aspects of this general point in Section IV, below. . 

Within the economic classification of costs, there was some discussion 
of the specific categories often used by economists to analyse costs, such 
as fixed, variable, marginal, average, capital and recurrent costs. While 
there appeared to be some confusing differences in nomenclature between 
economists (primarily between economists from different countries), the 
concepts were felt to be similar, and were seen as essential to the analysis. 
A. discussion of alternative categorization schemes can be found in the 
recent Unesco publication referred to above. 

There was some discussion as to whether, and at what rate, to 
amortize the costs of capital equipment. Although there is a clear 
consensus as to the necessity of discounting capital expenditures, there 

appears to be some disagreement as to its practical utility in education 

media evaluation. It is certainly true that there is considerable contro- 
versy over the particular discount rate which should be used and that the 
time preferences of society and decision-makers may vary. None the less, 
it seemed to be the opinion of most economists at the conference, and it 
ìs certainly our opinion, that if costs are to be considered in social decision- 
making, then the opportunity costs to the society of tying up capital must 
be integral to the analysis. Not to consider such costs is to bias the 
analysis in favour of capital-intensive alternatives and can make a sign 


cant difference in the choice between alternatives. This is shown clearly 
in the report referred to earlier by Ja 


There was also some discussion 
costs from the perspective of 


it seemed difficult, and perhap: 
categorization of economic cos 
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n MM. pee marginal and opportunity costs, are decision- 
mein pe — on the specific question asked. There was 
tones : “mn that cost information should be collected on as dis- 
i a basis as feasible so that aggregation appropriate to a wide 
ange of decision questions would be possible. 
gt Ev there was some mention of the value of a broader concept 
Mee hat would include psychological or cultural cost facets of a 
cision. Although not usually quantifiable, especially in a monetary 
ep a commonsense concepts were seen as having significant utility 
veas UN. It is also possible to treat such costs as effects rather than 
os ol sources whose cost can be calculated, and build them into an 
nalysis of efficiency, effects and benefits as negative consequences of the 
particular educational strategy proposed. 


The nature of the cost analysis 


Although the nature of cost analysis is fairly well defined, given the 


npe concept of costs and a specific decision question, there were a 
nA pee points made at the conference with reference to this topic. 
conda CIAM participants stressed the point that the type of analysis 
relate cted is directly tied to the decision question and perspective, which 
Secti s to the level of decision-making questions raised above and in 
in IV. Such considerations lead onc to stress the analysis of costs as 

ions of decision and situational variables, instead of costs as simply 
monetary numbers, and there appeared to be general agreement that 
More emphasis on the former approach is necessary. 

Secondly, there was some discussion of one particular type of cost 
ja Aa analysis of a summative, historical nature usually undertaken 
Sed effort to facilitate international comparisons and provide for the 
Sternal of information to educational planning situations Im which 
data n information is often the only source of certain types of relevant 
some espite general agreement that more of such studies are needed, 
of PA ian expressed strong reservations about the transferability 
edis h results. Many felt that the genera n in these 

analyses was considerably more relevan 
Senerated. 
igen inally, given the uncertainties that surround the collection, 

urement, and projection of costs, there was strong agreement as to 


€ necessity of examining the sensitivity of the analysis of reasonable 
This clearly relates to the choice of 


a cations in the assumptions made. r s : 
So discount rate for annualizing capital expenditures, for which 
A sensitivity analysis 1s commonly used by economists. But more 
Physi this, there is a need to examine other assumptions—human and 
Being, resource costs, equipment lifetime, the growth rate of costs over 

> etc.—variation in all of which may significantly affect policy 


Choices, 


l approach take 
t than any specific results 
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Cost-effectiveness and cost-benefit analysis 


For this topic, which formed the focus for the second day of baec get 
discussions, there were two background reference documents and ues 
d especially for the conference: S. Wells's book! a USAI 
paper prepared esp y Mies 
and report by Klees and Wells? served as reference documents, w! en 
shorter paper by Klees and Wells summarizing their longer report abo 
served as a working paper for the session. m" 
In general, there was considerable divergence over the approp 
ateness, utility and practicality of the economist’s framework for this s 
of social evaluation. Some participants pointed out that cost analysis by 
itself had little or no decision value without an examination of € 
effects and benefits. Cost analysis in theory related resource costs 5 
System outputs more than inputs and thus the question of output 1 
integral to cost analysis. Other participants pointed out the Mcd 
methodological and empirical difficulties in looking at the output S! 


and stressed that cost analysis was the primary practical tool economists 
had to offer decision-makers. 

A few partici 
tered in measuring benefits in monetar 
of costs; most seemed to feel that 


cognitive effectiveness an 
affective outcomes, lon 


that can utilize alternati 


a consideration that we now turn. 


1. S. Wells, Instructional Technoi 


es n 
logy in Developing County; ision-making Process 
Education, New York, Praeger, 1976. Ping Countries, Decision giri tional 
2. S. Klees and S. Wells, Cost Effectiveness and Cost p. Analysis for Educ 
Planning and Evaluation, Washington, reae ind 


D.C., USAID, 1977. 
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III The education process 


A variety of issues relating instructional technology evaluation directly 
to the educational process were raised during the conference: the relation- 
ship of inputs to outputs, the neutrality of technology, the impact of 
x technology alternative on economic analysis, the delineation of an 
optimum' configuration of technology for the solution of a particular 
education decision, the distinction between big and little media, the 
emphasis placed on hardware and software, and the potential effects of 
ever-changing communications technology. A crucial issue not discussed 
in detail at the conference, but raised in the context of marginal cost 
analysis, is the interrelationship of education and general communication 
needs through the use of technology. Each of these issues is discussed in 
turn, and from each we draw conclusions relevant to future research and 


the role of funding agencies. 


Input-output analyses 


particularly cost-effectiveness and 


In undertaking economic analysis, 
g costs and 


Cost-benefit research, we are usually in the position of addin 
Comparing these costs with effects and benefits. In effect, we treat the 
education system as a black box into which one puts some combination 
of resources (including technology) and from which one derives some 


Specified outputs. However, there is little understanding of the potential 


Cffectiveness impacts from alterations or modifications in the basic combi- 
ic analyses aimed at 


nation of inputs. There have been many economi 
uncovering relationships between inputs and outputs. However, most of 
these studies have used process models based more on statistical con- 
venience than on well-established learning theories. It was observed that 
this Investigation of the black box is more a matter for education theorists 
than economists. Yet, without these studies, little can be said regarding 
APPropriate input combinations which might improve learning. Further- 
More, there are very few such studics that look at instructional technology 
alternatives and those that do have tended to be on gross levels, comparing 
the utilization of technology with its non-use. 
. We know little of the circumstances in which a particular technology 
18 appropriate: with which types of teachers, learners, or curriculum we 
Should match a technology. Research strategies need to be developed in 
this area, Otherwise, we may well be able to identify those instances 
Where a technology project failed or succeeded but will not understand 
te reasons why and will have difficulty building a base of knowledge 
With which to advise other countries. 
Tt was also recognized that while there has been analysis of effective- 

Ness (direct educational outcomes), there was insufficient analysis of social 
Outcomes of education or the link between educational outcomes and 
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social outcomes. Many participants expressed the feeling that while this 
investigation was particularly appropriate to the economic analysis of 
education, it was not necessarily relevant to an investigation of instruc- 
tional technology. This latter opinion rests on the belief that equal 
outcome alternatives are being compared on a least-cost basis, which may 
be problematic even for rather technical choices, as pointed out below. 


Neutrality of technology 


Several people expressed the view that a given instructional technology 
was simply an alternative delivery system for some curriculum and, 
therefore, the type of technology utilized would be irrelevant to any 
estimation of benefits. The analytic impact is that an ‘optimal’ resource 
combination can be separately chosen for given educational outcomes. 
Independent of this analysis, one can then specify the relationship 
between educational and social outcomes. However, this view contradicts 
advantages attributed to technology by its proponents, such as technology 
being an important ingredient to spark an educational reform, Further- 
more, during the course of the conference, ‘cultural’ costs were frequently 
mentioned, although never specified. One can only infer that ‘cultural’ 
costs may well exercise some influence of the technology system separate 
from the curriculum delivered. 

If one looks beyond the instructional technology field, there is 
considerable literature on less overt media messages. For example, does 
increased television-watching preclude the need for reading? Do people 
place a different value on the ‘truthfulness’ of different media messages? 


Is a particular technology more appropriate to a particular economic OF 
cultural system? 


Obviously, 
analysis of instructional tech 


ysis to technology systems. Question? 
issues which deserve more intensive 


Technology and economic analysis 


There was considerable discussion 
educational technologies to be cons 
subsection, we wish merely to em 
ization of technology affects the a; 
discussed the potential non-neutr: 


of the interrelationship between the 
idered and economic analysis. In this 
Phasize those areas in which the u à 
nalysis. In the previous subsection oe 
ality of technology and advised furthe 
> other impacts of instructional technology 
seemed to be acknowledged by many of the participants. The reductio” 
of student-teacher ratios in multigrade classrooms was viewed as a. positiv® 


impact. The pacing and scheduling forced by the technology system were 
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seen positively or negatively, depending upon the individual’s perspective. 

A major issue for some types of technology is the dramatically dif- 
ferent cost patterns to be observed in comparison with traditional sys- 
tems. Technology systems tend to have major investments in early years 
of implementation. 

The implication of different benefit and cost patterns is that one 
must adopt a methodology which would result in meaningful compari- 
sons. As different technologies may have positive or negative effects on 
different measures, one must adopt methodologies which account for 


altering sets of criteria. 


‘Optimum’ configuration 


Several persons held the opinion that the primary role of economic 
analysis was, on a micro level, to find an ‘optimum’ resource configur- 
ation that would result in minimizing costs for a fixed output level. This 
opinion implies that the relationship between inputs and outputs is 
actually understood, and that one could alter input configurations 
without changing output. The research implication drawn from this is, 
again, further investigation of input-output relationships and, perhaps 
more importantly, more research directed towards solution of specific 
decision questions. Not all economic analysis should necessarily be in a 
global context involving choice among major systems; some should also 
involve decisions within the constraints of a previously chosen system. 


Big media—little media 


Some discussion was focused on the difference between big and little 
media. While there was considerable agreement that little media tended 
to be ignored, several definitions were offered distinguishing little media 
from big media and providing rationales for the tendency to neglect the 
former. When this dichotomy was first proposed several years ago, the 
Implication was that big media were more expensive. While this dif- 
ference may be true for hardware investment (and this is not certain), 


the tendency is to ignore two major cost items for little media: distribution 


and electrical power. With poor transportation and the unavailability of 


€8s-expensive main-line power, these two iten i 
Sreatly to operating costs. Over a long period of time, 


System may be the more expensive. i 7 

An a Mesa definition offered was that big media tended to 
require large initial investments in equipment while little media had 
lower investments. Tied to this point were the underlying decisions in 
international funding of media projects. F unding tends to be available 
or major investments rather than operating costs. Preparation, dupli- 
Cation and distribution of material for little media tend to be viewed as 


Perating costs. 


tems are likely to contribute 
either media 
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Another definition offered was that big media tended to be highy 
centralized, whereas little media were decentralized. The — Fa 
centralization would be a greater desire for curriculum contro > heer 
unwillingness to rely on teacher ability and initiative in all eis du n 
country. However, little media may still involve centralized oer nes 
production. The teacher would then have a scheduling option. Big iow 
use does assure that if equipment is functioning and teachers fo 
directives, lessons may be centrally paced. bs 

Related to this definition was one which distinguished between t ei 
media for which teacher involvement was necessary and those for whic s 
it was not. However, it would seem that onc could establish a acier 
student-medium interface for any medium and have a student-teac "i 
interface as a lead-in or follow-up to any medium use. An adinon 
reason for the relative neglect of litle media was a lack of gana 
attached to these media and the fact that their use tended to be ? 
local option. ie 

On one point, however, there was virtual unanimous ageert 
big media (radio and television) are the most studied and little m 
(everything else) are the least studied. The important recommendati - 
derived from this discussion was the need to place much strong! 
emphasis on little media systems, especially in planning studies. 


Hardware and software 


When we think of media s 
and equipment. An instr 
facilities, television sets 

mitting messages (satellites 
components of a media s 


Everchanging technology 


€ 
The communications field is one of rapidly changing technology- Ther" 


duction. The implication for education i d funding 


is that researchers an a 
: HM : res ih? 
agencies must not become so fixed in given education structu 


Reports of meetings 
287 


they. fai P m 

st l he "y No cducation possibilities of new innovations. It was 
ed that t i <perti i i > 

i echnical expertise be included in any planning 

FI chor of technology does pose two problems for developing 

in pened (a) a potential inability to deal with pressures of hardware 

en, and (b) an increased likelihood that outmoded equipment may 


be thrust upon developing countries. 


Education and general communication needs 


eo = acera briefly mentioned in the context of marginal cost 
ina Deshi : t ^ ink between education and other communication needs 
&xXided in 3 t was suggested that if a radio or television system already 
Sting this e country, then one need only consider the marginal cost of 
sri ystem for education. The more general point which emerges 
nation der a a need to co-ordinate education planning utilizing communi- 

nology with general communication needs. Otherwise, if the 


education system is made the focus, facilities may be duplicated or equip- 
ial saving through 


me e 
«cen may be unnecessarily purchased and potenti 
ing of facilities may be ignored. 


IV The decision process 


ussion of the relationship of the 


Thr " 
oughout the conference there was disc 
ducation decision-making pro- 


eco; i 5 N 
iis, Te and economic analysis to the e 
* In this section, we discuss three aspects of this relationship that 


Seeme A A A . 
ed to be focal points: (a) the source of the objectives and questions for 


analysis: E A ng a a 
year (b) the interaction between the type of decision situation and the 
economic analysis engaged in; (c) the dissemination of skills useful 

s. Naturally, all 


to ec 
oi A E 
Een nomic: analysis and results from economic analysi 
issues interact considerably. 


Objectives and questions 


stressed the need to begin an analysis with 
nquiries such as ‘How much does 
ollected may be quite different 
than when the real interest is 
licability of the project to a 


dotes of participants 1 
this Mer rie as opposed to general i 
bra bn For example, the information c 
Since cost summary of a project 

: rated on project expansion or app 


“ferent environment. 

Sie if a decision question is involved, by what criteria should 
ive answers to such questions be judged, and from what source 

be obtained? Such concerns led 


Sho k: 
^ a both these questions and criteria 
me questioning of the role of the ‘decision-maker’. Some participants 
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noted that economic analysis, with its traditional ‘optimization’ framc- 
work, is well suited to work with a central decision-maker. However, 
others cautioned that in many situations there are often no identifiable 
individuals who are decision-makers, but some sort of amorphous political 
process by which decisions get made and within which it is hard to 
identify the locus for discussions of the relevant questions and objectives. 

Clearly of great significance is the question of whose objectives are to 
guide system choice. The view that economists should accept decision ques- 
tions and objectives laid down by people who are in positions of public 
decision-making responsibility received support by some participants. 
This view was tempered, however, by the recognition that economics 
traditionally has a number of evaluative criteria that emanate from within 
it, related to conceptions of social cost, social benefit, and economic 
efficiency. Therefore, many participants argued that the economist shoul 
actively foster the incorporation of such criteria into the decision-making 
process. A number of people remarked on the lack of specificity of objec- 
tives that characterize many initial decision situations, and it was cel 
tainly appropriate and perhaps necessary for economists to help clarify 
decision questions and objectives. There seemed to be fairly uniform 
agreement that one potentially valuable role for economic analysis is 19 
help make decision assumptions and criteria explicit. 

Finally, there was recognition that a public-sector decision process is 
a political process in that there are various groups involved often with 
conflicting interests. Some participants argued the necessity of competing 
interest groups undertaking their own economic analyses. Although this 
runs counter to the traditional economic approach, two rationales pro- 
vided some justification for undertaking competing ‘analyses First, some 
argued that the traditional ‘objective, value-free’ stance of mainstream 
economics is incorrect and that economic efficiency has serious flaws, both 
in conception and application, which render its use as a criterion More 
a political judgement than a scientific one. Second, others argued that 
even if one felt confidence in competitive market economic theory, our 
ability to apply it is so inexact that analysts could in ood faith, disagre® 
within the paradigm. Within a very centralized deciden process, these 
d provide a rationale for the same decision authority funding 
evaluations from different perspectives. Of course, given that the centra 


authority may be one of the interest Š is abili 
to fund a study with a different biaa ow itself lends doubt to 1ts 


Decision situations 


There was considerable refc i ; " ] s O 
erence in the discussion to particular aspect d 


the decision situation and how they might affect the role of economist 2” 
the nature of the analysis. Different levels of decision-making perspective 


and responsibility were suggested as having different analytic implic?” 
tions. Distinctions were made between international agencies like Uncse 
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and the Internati i i i 
national pao | a E ss add d Lee rq aee 
Bank, national decision-mak eem : shee i hg 
gegen arte ion-makers, and project management. "These different 
as cok cae E were sometimes. associated with (and some- 
S use with) different types of decision questions, such as those 
ated to financing, social costs, or media mix. 
"HE. the type of decision question being asked has clear implica- 
"moris e pe of analysis that is most useful, the effects of the level of 
discuss doi on the analysis did not seem to be well clarified by the 
n ons. Certainly there was a dimension that relates to the point made 
Cd acus subsection—that different decision perspectives may view 
abla a as costs and benefits. But more than this, there was con- 
€ iscussion of the particular aspects of economic analysis most 
conferen particular decision situations. Arthur Melmed, chairman of the 
ce, summarized his view ofthe proceedings within this framework. 
ese Eu general, a number of participants felt that cost analysis was the 
Sein up component of economic analysis and would be of most use to 
A Wess decisions. However, others argued that cost analysis could not 
of bra cad considered by itself without an integrated examination 
Me es effects and benefits. Some added that the most questionable 
ics ptions of economic analysis on the benefit side were the same as 
€ made on the cost side and thus both types of analysis potentially 


h ES WE 
23 the same flaws. The discussion reflected an underlying difference of 
pinion, sometimes explicitly expressed, over the decision importance of 


sep technical, quantitative, empirically based 2 
ap re to the usefulness of the more qualit 
Piae of the economist. Which aspect Is stre 
anal € nature of the analysis undertaken and 
ysis skills to others. 
Bap t was fairly broad agreement that in many decision situations 
Fisco dum effort than is currently the practice should be put into 
imple S continuous analysis of projects, from the planning stage through 
eyiini o with permanent economic evaluation built into the 
agreem operational phase of the project. There was also fairly uniform 
ibe ent that, given the complexities of most decision situations, econ- 
spe 5 should be integrated with analysts from other disciplinary per- 
Ctives into a multidisciplinary evaluation effort. 

de ds general, despite the view that economic analysis as an aid to 
Mime. PE is more or less uniformly applicable, it would seem that 
and a should be given to the particular approaches to analysis 
could eir relationship to particular decision situations. Such attention 

ite Perhaps be most usefully generated through closer interaction 
these €n economists, researchers from other disciplinary perspectives, and 
ice Pe responsible for making decisions, both in actual project 

ions and in meetings designed specifically for that purpose. 


ed aspects of economic analysis 
ative, general conceptual 
ssed has clear significance 
the transfer of economic 
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Dissemination 


Relatively few economists are currently engaged in efforts to look at the 
economics of educational media strategies, and few decision-makers or 
researchers from other disciplines have the requisite background to inter- 
pret sensibly the economic work that is being done. Both of these con- 
siderations led to general agreement that more attention should be 
focused on the dissemination of economic analysis results and skills. 

More widespread dissemination of studies was called for. There was 
some debate over whether the results were very generalizable, but even 
if the results were not, participants felt that the approach taken was 
likely to be, and thus, in either case, this recommendation was considered 

Some participants argued that some sort of data banks that collected 
quantifiable information from specific evaluations could be useful, while 
others felt the limitations on generalizability would preclude this specific 
approach from being very effective. 

There was a general consensus that the dissemination of econ- 


omic analysis to non-economists, especially to decision-makers, is of 


essential importance in fostering the interaction between economists an! 
other parties involved in the decision process. It was felt that such dis- 
semination of both conceptual framework and technical skills require 
a multifaceted approach involving clearly written papers on the subject, 
supplemented by personal interaction, seminars, and extended education 
and training efforts. There was significant concern that the recipient be 


integrally involved in questions of the substance and form of such dis- 


semination activities. In exchange, economists would be exposed to the 
process of decisions and the 


practical implicati ir assumptions 
and methodologies. Pinstuap OF thet p 


V Conclusions 


In a sense, this whole report represents the conclusion, as viewed by the 
rapporteurs, of the conference deliberations. The wide range of topi® 
were discussed or touched upon. All have implications for the many 
different groups involved in the evaluation of educational media altern?” 
tives—economists, and other researchers concerned with education; €dU- 
cational decision-makers, administrators, and users; and internatioD? 
organizations involved in financial and technical educational develoP" 
ment assistance. In this section we briefly summarize what we see as 
the major suggestions and orientations for future work that came out ? 
the conference. Most of these points apply in some respects to all thre® 
audiences above, but are grouped here in four general categories: 


Cost 


asked ; 
Osl-effectiveness and cost-benefit analysis 


I. 


G ; 3 f h 
i eneral educational and analytic considerations 
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Methodological approaches to research 
and evaluation activities 


analysis 
Divide media system costs into the technical classification proposed: 


production, transmission or distribution, reception, and central 
administration components. 

Divide media system costs according to a financial classification 
depending on which groups pay. 
Do not attempt to standardize within the economic cost classification, 
as classification by such concepts as fixed, variable, and marginal 
costs should reflect specific decision questions. 

Collect and present information on physical resource use, 
to monetary costs. 

Collect and present (or at least mak 
physical cost information on as disaggre 
allow for aggregations specific to other 
consideration at the moment. 

Structure cost analyses so that they re 
decision questions. 
Structure cost analyses so t 
evant decision and situational variables, 


Sidering costs as numbers. 

Devote research efforts towards integrating different dimensions of 
individual and social costs into cost analysis, such as psychological 
and cultural aspects of costs. 
Include opportunity cost estima 
media projects, not omitting the use 
to discount capital expenditures. 


in addition 


e available) monetary and 
gated a basis as possible to 
decisions than those under 


flect responses to specific 


hat they reflect costs as functions of rel- 
as opposed to simply con- 


tes of non-priced resources used in 
of alternative social interest rates 


nd benefit criteria in future studies, 


Include multiple effectiveness a 
dimensional emphasis on cognitive 


as opposed to the prevalent one- 


effectiveness. 

Attempt to structure the analysis and employ techniques to yield 
more detailed understanding of the relationship between educational 
Inputs and outputs, as opposed to examining the ‘black box’ effects of 


a system as a whole. 


evote more research effort to technology systems which do not 
d ‘little? media systems. 


use radio and television, especially so-calle 
Devote more attention to software components of technology systems. 
Consider wider societal communication needs in analysing tech- 


nology systems for education. 
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Investigate the non-educational impacts of particular technologies 
more thoroughly to determine the extent to which it is reasona jd 
to choose an educational delivery system based on educationa 
impacts alone. d 
Devote considerably more effort towards further conceptual an 
methodological work relevant to the theoretical validity and prac- 
tical applicability of these types of economic analyses. ] d 
Undertake sensitivity analysis within all economic analysis base 
on reasonable alternatives to the main assumptions used. 


Relating research and evaluation 
to the educational decision-making process 


Tie management information systems, most specifically those for 
accounting data, to the requisites for economic analysis. 

Promote the incorporation of criteria relevant to total societal costs 
and benefits that emanate from the economist's framework into the 
framework used by decision-makers at all levels. 

Undertake analysis from a variety of different, even perhaps kort 
peting, decision perspectives, recognizing explicitly that decision" 
often take place in a political process of divergent views and tha 

analysis is not neutral. ds 
Focus more research and more practical studies on the different necc ë 
of different levels of decision-makers and the potential for economi 

analysis to be more level-specific. 


Foster the inclusion of economic anal 


: ysis through the final impleme?" 
tation phases. 


4. . . i i 3 
Promote multidisciplinary efforts in conjunction with are 
decision-making activities, bringing together economists, researc 


B n t e 
from other disciplines, and decision-makers, recognizing that all hav 
much to learn from each other. 


Dissemination and transfer of economic research 
and evaluation skills and results 


— h- 
Promote the inclusion of economic analysis approaches and ge 
niques in formal training programmes that exist for decision-m? g 
at all levels—general policy planners, education sector analysts 
decision-makers, and project managers, ining 
s z n 
Promote the circulation of reports, conceptual and technical tra! a 


documents, and lists of information Sources and experts who 
able to serve as consultants to decision-makers at all levels. d 
Promote the use of international teams of analysts who € t 

bring expertise and the relevant experience of former prO p 

working with, and providing training for, personnel involve dni 
projects. 
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4. Promote dissemination activities relating to conceptual aspects of 
and generalized approaches to economic analysis, as well as the 
transfer of more technical skills. 

5. Integrally involve the recipient in determining both the form and 
substance of dissemination activities. 


Specific foci for international aid organizations 


1. Support studies dealing with the evaluation of more than one 


medium of instruction. 

2. Support studies that integrate cost considerations with effectiveness or 
benefit considerations, as opposed to those that treat each separately. 

3. In line with the foregoing point, encourage economic analysis that 
takes place within a multidisciplinary context and that examines a 
wide range of system outcomes. 

4. Do not attempt to impose too detailed or standardized a framework 
within which to structure such economic analysis. , 

5. Encourage and support more theoretical and methodological 
research in line with the suggestions made earlier, as well as more 
practical case-studies of projects at various stages of development, with 
an eye on lessons to be learned for both analysts and decision-makers. 

6. Devote significantly more effort towards promoting dissemination 
activities as suggested above, through providing considerably more 


opportunities for interaction between economists and other decision- 
makers in the form of global and regional meetings, position papers 
ilitate mutual learning. 


and manuals, and other activities that will fac 


Final report of the Conference on ; 
Economic Analysis, Factor in Decision-making 
on Educational Technology, Dijon 19-23 June 1978 


Rapporteurs: E. Arena, E. G. McAnany and F. Orivel 


Preparation and organization of the conference 


The conference was organized jointly by the French National Com- 
Mission for Unesco and the University of Dijon and was held in the 

Versity’s buildings. The Institut de Recherche sur P Économie de T Edu- 
“ation (IREDU), which comes under the University of Dijon, and the 
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Centre National de la Recherche scientifique (CN RS), handled prenita 
arrangements and provided the secretariat. The Director of € E : 
Professor J.-C. Eicher, acted as the scientific director of the confere a 
and Mr F. Orivel, senior researcher at CN RS, served as secretary-gener 1 

The International Council for Educational Media (IGEM) ane 
a great deal with arrangements, particularly by organizing the waye in 
participants from developing countries and by preparing working pap a 
The International Development Association (IDA) of the United Sta 
and the EDUTEL Company also afforded valuable assistance by making 
it possible for most of the Americans and Canadians to attend the meeting 
and by submitting case-studies. id 

Through the efforts of Mr Futagami and Mr Jamison, the Wor " 
Bank played a decisive role in drawing up the preparatory documents x 
the conference. The financial, practical and human contribution 
Unesco should also be gratefully acknowledged. 


Economic analysis of ed 
the state of the art 


The first da 


ucational technologies: 


y of the conference was devoted to a review of past experience 
in three important areas: economic analysis of educational technology: À 
the experience of developing countries in handling educational e 
nology and the present situation of the educational media in ae 
ized countries. These were dealt with by J.-C. Eicher, E. G. McAna 


ir 
and R. Lefranc respectively, all of whom devoted the bulk of the! 
contributions to d 


3 in the 
efining the main problems at present found in t 

three fields. 

i; 


In the opening paper, 
of New Educational 
findings before raisin 
view, required mor 
found at the begin 


" is 
"Some Thoughts on the Economic eei 
Media', Jean-Claude Eicher reviewed rc his 
E à series of questions on points which, 1n be 
€ thorough investigation. His paper is to 
ning of this volume (page 9). d 
2. Ina paper reprinted on Page 48 of this book, E, G. McAnany ap 


what criteria Should be used to judge wheth. edia projects in 
Third World have or li Judg ether m p 


ave not been successful. 
3. Lastly, Robert Lefranc ci 


the 
zu ploy audio-visual techniques to back P Inods 
traditional approach to teaching. This gradually led to teaching € 


more satisfactorily integrated. 
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Next, the late 1950s and the 1960s witnessed the use of mass media 
such as radio and television to meet the particularly pressing need for 
teachers in certain subjects such as mathematics, science and languages. 

A third stage, overlapping the second one, saw the development 
of completely new teaching systems based on the media themselves. 
Although still experimental, this approach is attempting to rethink 
education as an interactive process involving students, teachers and 
the media, and has brought into being systems of distance learning in 
which the ‘school’ disappears and hitherto excluded social groups are 
m the opportunity to study, particularly at the secondary and higher 
€vels. 

Summing up, Lefranc said that in the last twenty-five years, those 
approaches had not replaced one another but had been added to each 
other and still existed side by side. 2 ult 

Lefranc considered the chief educational objective in the present 
decade had come to be the democratization of educational opportunity. 
In his view, the media and their growing ability to spread information 
are making it possible to develop individualized instruction and thus 
Promote mass education. The media are also making it easier to give 
everyone the opportunity to learn. The cost of equipment is tending to 
fall and there is a growing variety of software. Teaching methods are 
ollowing this lead as the media become more co-ordinated (systems 
analysis and the promotion of pupil creativity) but these developments 
are making it necessary to retrain teachers in the new wem ou , 

In his final section, Lefranc turned to certain problems raise : y : e 
development of the media. First, the question of strategy: should e r 
Cation systems be reformed little by little or as a whole? The secon 
Problem concerns the teaching profession’s trend towards teaching je 
made up of librarians, media specialists, documentalists, etc., es ewer 
teachers of the traditional type. Problems of production and € ci 
re necessitating more co-operation between education systems an: ve lia 
Industries; Architecture must be rethought to accommodate the me S 
School administration must provide new staff categories and Dun y 
Organization, and educational budgets must be redesigned. wie y, the 
author reiterated his belief that the best way of providing ane dera 
ec Closely adjusted to the individual personalities of students was by 
usin; t Su ' 

k he am during the debate which followed these nior 
ductory papers have been grouped under four broad headings: (a) : A 
Comparability of studies; (b) effectiveness criteria; (c) technologica 
transfer; (d) the specific problems of non-formal education. 


Compar, 55 ^ 
abilit dies à a 
There Wen dir deal of discussion about the extent to which studies of 
Projects with very distinctive settings and features could be of use in 


Making decisions in quite different situations. Some held that apart from 
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certain analytical techniques, case-studies contained little that was genu- 
inely helpful in responding to new situations. Others argued, however, 
that studies of this kind serve a useful purpose when they draw attention 
to environmental factors which vary from one project to another and 
thus allow what is constant to emerge. That was a basic principle when- 
ever it was wished to generalize social science findings. Since similar 
applications of distance-learning systems are being tried out in very 
different contexts, the results of cost-effectiveness studies can help to 
define models of use to the planner or policy-maker. Jamison and 
McAnany, in a recent book (1978), have attempted to highlight this 
kind of model. In his address, McAnany suggested developing planning 
techniques which would not just monitor the projects’ internal factors 
but would also seek out the external or environmental factors that were 
favourable to the success of that kind of project. 


Criteria of effectiveness 


Participants broadly agreed that project effectiveness had been analysed 
less thoroughly tha: 


n costs and that the selection of criteria of effectiveness 
Was a greater source of disagreement than the selection of cost Pa? 
ameters. Eicher in particular pointed out that there is still little agree 


ment on what effectiveness actually means in most educational technology 
projects. McAnany spent much of his paper on showing how effectiveness 
criteria chan 


a ge from one project to another and are often founded on 
value judgements belonging either to the project itself, to the evaluation 
or to those who ask for the evaluation. Most participants agreed that 
cognitive measurements alone were not enough to gauge effectiveness, 
but there was no detailed discussion of exactly what other indicators 


should be taken into consideration. Some progress on this point, however» 
was made in the 


working gro ; roblems 
and sélutions), € groups (see the section below on p 


& some sympathetic to employing the ™ = 
fies ubt on the realism of the estimated cost 2 s- 
the possibility o new technologies. Some of Lefranc's sug8° 


o 
central concern being to concentrate 
more modest and hence less costly media. 
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Non-formal education and choice of technology 

A relatively new interest has been taken in non-formal education, which 
covers many areas from adult literacy programmes to campaigns aimed 
at improving health standards, hygiene, nutrition or agricultural pro- 
ductivity and development. So far there have been few attempts at 
economic evaluation in this field, but several conference papers dealt 
with the issue. Howard Tuchman summarized his cost study of the radio 
school in Colombia (ACPO), an important study in that it could provide a 
methodological framework for the thirty-three educational radio projects 
Operating in Latin America. Joanne Leslie used a dozen cases, unfor- 
tunately without data on cost, to show how the media had been used—and 
with what success—to improve hygiene and nutrition. Bella Mody ana- 
lysed the external factors of change in an Indian village involved in 
the SITE project (Satellite Instructional Television Education) during 
the year 1975/76. H. Razavi presented some thoughts on the concept of 
educational technology and Raymond Postgate defended ‘soft’ tech- 
nologies which use small-scale, locally controlled media designed to 
meet the needs of clearly defined social groups in both developed and 
developing countries. 3 ; 

It emerged clearly that non-formal education was faced with prob- 
lems similar to those of formal education and others besides, but did not 
have the same experience of evaluation. New technologies are increas- 
ingly important in this field but there is still little information about 
Costs and effectiveness. Many participants stressed the urgent need for 
economists and evaluators to take a close interest in non-formal edu- 
Cation. Jamison and McAnany have, in fact, devoted part of their 
Tecent (1978) book to gathering available information on the role of 


radio in this field. 


Problems and solutions 
to six working groups to 


For two days the conference separated in M 
e-learning systems at the 


examine the following problems: (a) distanc s à 
Post-secondary level; (b) other distance-learning systems, in particular 
for non-formal education; (c) use of the media in schooling; (d) imptove 
ment of existing systems by means of the mass media; (e) criteria E 
deciding on the choice of media; (f) analysis of Latin-American media 
Projects, T 

The groups made what use they needed of the working documents 
at their disposal and appointed rapporteurs to record their conclusions, 
Which were later distributed to all participants and examined ata plenary 
Session, The main points that emerged from this examination can be 
grouped as follows: (a) the scope of economic analysis; (b) definition and 
Measurement of effectiveness; (c) decision problems in regard to edu- 
Cational media; (d) the usefulness of economic analysis; (e) the role of 


Economists. 
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The scope of economic analysis E 
Economic analysis is a technique that can contribute to the decision pro- 
cess regarding a given educational technology. The questions that econ- 
omists ask, and seek to answer, may not be very different from those 
asked by educators or planners, but concentration on cost and cost 
effectiveness might distract attention from more fundamental issues such 
as the relation between education and Society. Certain participants 
remarked that economic analysis is not always neutral: the economist $ 
criteria might be distorted by concerns of the organization paying for his 
analysis or by his own ideological stance. 

Morcover, many of the studies referred to in the discussion tended, 
largely for technical reasons, to be cost studies rather than true cost- 
effectiveness analysis. Even when ‘benefit’ or effectiveness indicators were 
present, they were rarely set in a true cost-benefit framework. 


The definition and measurement of effectiveness 


Even though some of the documents provided for participants offered 
formal definitions of effectiveness and how it should be measured, no con^ 


sensus was reached on this point. The fact that the concept has so many 
facets naturally tends to complicate the task. It was suggested by some 
Speakers that every case- 


. study should examine the internal, Bl 
and systematic aspects of effectiveness. Internal effectiveness might 


judged on the pass, repetition and drop-out rates and on the extent tO 
which resources are utilized 


were the achievement of s 
improvements in 
productivity, 
munity, 
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tations and constraints, it was recommended that the most awkward 
aspects of the projects should be evaluated at least qualitatively rather 
than simply disregarded. 

Thirdly, it has to be recognized that a very long time elapses between 
the start of an educational project and the moment when its final effects 
may be observed. The result is that cost-effectiveness analysis often takes 
place before long-term effects can be gauged. A different though related 
problem is that the results of a pilot project cannot be extrapolated to one 
on a normal scale since there are always differences in motivation among 
project leaders, teachers and learners. 

The fourth problem concerns what economists call the production 
function of education. There is at present no proper theory to explain 
how inputs relate to outputs in the field of education. With no unchal- 
lenged model of causal relationships in regard to education, it becomes 
very difficult to isolate the impact of a particular medium on a given 
educational process. 


The problems of deciding about educational media : 
The case-studies prepared for the conference shed little light on how econ- 
omic analysis had affected the decision process. True, economic analysis 


is still a novelty in this field and the projects studied existed before it was 


introduced. The case-studies are mostly a posteriori cost studies, with a 


few on effectiveness, but none deal with comparative cost-benefit analysis 
prior to decision-making. 

In spite of these shortcomings, there seemed to be general agreement 
that economic analysis should play its part in decision-making and be 


Part of the multidisciplinary effort to weigh up the implications of various 


Possibilities and thus clarify the decision process. The systematic organiz- 
ic analysis provides a convenient 


ation of information involved in economii X 
working framework and the economist’s viewpoint can sometimes serve 
as a valuable check to the adoption of solutions which are fashionable but 
disastrous in the long run. 

Thorough analysis of actual decisions t in, tiona 
media might reveal that information available for decision-making 1s 
often incomplete and that a bias exists in favour of certain factors. When 
a project is being prepared, for example, it can happen that i ite e 
external factors, such as political support, play a much more decisive role 
than considerations of economic efficiency. Several participants stressed 
the importance of distinguishing between the analysis of ongoing projects 
on the one hand and feasibility studies and policy decisions on the other. 
The technical decisions needed during implementation should be based 
essentially on solid, straightforward economic considerations. Some 
examples of this type of decision were given: (a) the cost implications of 
either using existing facilities more intensively—thus incurring higher 

abour costs—or expanding the facilities; (b) the cost implications of 
Various possible media combinations for a distance learning system; (c) the 


aken concerning educational 
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economic implications of decisions regarding the amount of educational 
content; (d) the implications of decisions on whether the target audience 
should be broadened or not. 

All these decisions share the need for a choice between the status quo 
and expansion, and call for marginal analysis and hence economic 
expertise. i . . d 

On the other hand, feasibility studies require closely integrate 
teams of educationists, planners and economists to define the problem, 
the objectives of the project and the intended audience, to select the 
media to be used, weigh up the available resources, advise on financial 
arrangements and lay down the relevant variables to be used in 
evaluation. 

Where policy decisions at the highest level are concerned, there are 
still too many obstacles to make direct comparisons valid, even though a 
certain amount of progress in project comparison has been made. The 
objectives, audiences, types of organization, environments, media com- 
binations and available information differ far too much for it to be pos- 
sible to classify systems in terms of cost-effectiveness and identify the 
‘best’ technology. Nevertheless, at an intermediate level, economic analysis 
can certainly make it easier to anwser certain strategic questions such as 
the one now being asked by the Latin-American Association for Radio 
Education (ALER)—can educational radio effectively attain certain pre- 
defined educational objectives at lower cost than regular schooling? 

A final point regarding the contribution of economic analysis to 
decision-making was that economics is not an exact science. Two econ” 


omists examining one and the same project might well reach opposite 
conclusions. 


The usefulness of economic analysis 
The economic analysis of education: 
in three areas: (a) economic studi 
on educational technology that di 
can now be used in shaping strate. 
(b) economic analysis provides 
financing by education ministrie 
has conferred international credi 
might well have collapsed. 


There is, however, a great deal of scepticism as to whether econon k 
analysis could modify positions already taken up. It has, moreover, com? 
up with few straightforward Proposals that could guide—if not opti 


mize—decisions which have to be taken without waiting for the finding’ 
of a detailed study. 


al technology has proved its usefulness 
es have built up a body of knowledg 

d not exist before, and this information 
gies for the development of new projec i 
more reliable foundations for proj e 
$ or international organizations; he 
bility on certain projects which otherw!§ 


The role of economists * 
The foregoing remarks indicate the ways in which economists could c? 
tribute to the taking of decisions about educational media. They ©° 


Reports of meetings 
301 


analyse resource allocation in the education process and help towards a 
better understanding of it: they could join teams set up to produce feasi- 
bility studies or advise on the most desirable education policy; they could 
be consulted on the economic or other consequences of alternative courses 
of action and thus improve the decision process; they could teach or 
spread certain analytical techniques and, lastly, provide a cogent ana- 
lytical framework for decisions about the media. 


Conclusions and recommendations 


The main purpose of the Dijon conference was to inform specialists in the 
use of mass media for education about the recent efforts—covering not 
more than the last ten years—of a few economists. The conference was 
successful in that 111 specialists accepted the invitation to come and meet 
22 economists, Contacts were made and a great deal of documentation 
on the economic analysis of the media, which will probably be read 
through carefully in the coming months, was distributed to participants. 
The conference led to a greater awareness of the need to set up pluri- 
disciplinary teams and gave participants a chance to discuss plans for 


future collaboration. 

The scepticism expressed in some quarters over the relevance of an 
economic analysis of the use of the media in education was more than 
justified when it served to counter a tendency to make economic analysis 
the central if not exclusive approach to the problem. If the economists 
were tempted to take this line, they will not do so again. Non-economists, 
on the other hand, were made aware that resource wastage cannot take, 
the place of a criterion for decisions about educational technology. The 
Dijon conference confirmed the end of an era in which recourse to the 
media in education was a fashion and gratuitous experiments could be 


conducted for pleasure. The new educational technologies of the coming 
decades will be those which provide higher quality and/or a greater 
es or which make 


quantity of services to education from the same resource 
it possible to maintain the same services at lower cost. 

. . The conference also gave close consideration to the creation of an 
international network for updating information on economic and tech- 
nical problems raised by the development of educational technology, and 


to future activities for the economic analysis of teaching media. 


Information network 
he document prepared by Dr K. Spangenberg! notes that there are 
hical information on education in the world 


Several networks of bibliograp ) 1 
but none of them satisfactorily covers the studies, reports and books which 


ation on Costs of Educational Media 


1. ‘Possibilities for the Inclusion of Informati t c 
Systems and on Characteristics of Audio-visual Materials and Equipment into 


the Information Network of Unesco-IBE". 
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deal with the economic analysis of educational technologies based on the 
media. Even though these documents have rapidly grown in number in 
recent years, there are no specialists handling this field in present infor- 
mation networks. Setting up a network of this kind, which Spangenberg 
refers to as COCEMS (cost and characteristics of educational media 
systems) presupposes answers to these three questions: (a) Who is it for? 
(b) What type of information should it convey? (c) How should it be 
structured? * 

Clearly, an unambiguous definition of its users would make it 
possible gradually to determine the kind of information wanted by 
means of feedback from users. Conversely, if a start is made by defining 
the kind of information to be circulated, the users would be identified by 
approaching the membership of existing networks within which most 


ut. This choice gave rise to 


à le to reach an understanding. 
Some had a clear idea of the information to be circulated and felt it 


unnecessary to worry about users, whereas others had well-defined users 
makers in developing countries) which, © 


ify the type of information to be circulated 
€r potential users. 


o and IB ibility 
study on a network of this typen E would undertake a feas 


Future activities in the econo 
Participants made a go 
summarized below. 


mic analysis of teaching media e 
od many suggestions on this subject. These 27 


nologies. For example, can a partu 
dasa Consequence of schooling, of t€ 
other factors such as the strong pull o 
means other than education? In prac 


3 


urban life-style conveyed by tices 
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the concept of effectiveness should be approached from several angles: 

A survey to find out who really wants information on the effectiveness 6f 
a project, and why. 

Research on classifying levels of effectiveness (internal, external, sys- 
temic, ctc.) in order to identify the effectiveness subgroups and 
establish a table to correlate findings; this table would then be set 
alongside the one drawn up for cost analysis. 

A cross-disciplinary study of effectiveness which would review the relevant 
work and findings in the social sciences, economics and the edu- 


cation sciences. 

A critical analysis of effectiveness st 
impact of new teaching media, wit 
methods employed to measure it. 


udies already carried out on the 
h the purpose of clarifying the 


Studies. Encouragement should be given to the formation of multi- 
disciplinary teams for the preparation, study and evaluation of edu- 
cational projects employing the new teaching media and a special effort 
should be made to carry out effectiveness and cost studies at the same 
time and in close conjunction with each other. One important aim of 
such studies, especially those dealing with ongoing projects, is to point 
out ways and means of improving the output of the structures, resources 
and facilities in use (optimization and maximization). Particular attention 
Should be paid to making the reports more readable, so that non- 
Specialists are not lost in a trackless jungle of theory. Lastly, it was 
stressed that the economic analysis of media systems should bear in mind 


the economic policy of the country in question. 

Circulation of economic research findings. Besides being used in large-scale 
Projects, the new teaching media are also employed in a great variety of 
small projects (resource centres, language laboratoires, closed-circuit tele- 
vision, multimedia schemes, etc.) none of which costs enough on its own 
to warrant the expense of economic analysis. There are, however, $0 
many of them that the total expenditure may exceed the cost of a big 


Project. This is why it is important for those in charge T Cn Du 
€cts—ve hers, school heads or inspectors—to have @ E 
ry often teachers, isions. One of the fore- 


meth, i i justify their decisi 
odological aids to help them justity jn i] SUME 


Most reco dati fth ference was that a g 
mmendations of the con. é x d 
media micro.systems should be produced. This would contain advice, 


Parameters and models to help decision-makers themselves (educationists 
Or Practising teachers) to analyse the systems’ economic aspects, predict 

eir cost and draw up budgets. The guide could also draw attention to 
the pitfalls and limitations involved in planning to introduce media-based 


Projects, 


concerned the organization of 


Training activities. Another suggestion conce : 5 
lication of economic analysis to 


Workshops or training courses on the app. 
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educational technology from the decision-making point of view. Work- 
shops of this kind, organized on a regional basis, should be for a limited 
number of active or future decision-makers and should include simulation 
techniques in which the group: would have to work on an imaginary 
example, carefully prepared beforehand. 


Institutions and experts 


Directory of 
specialized institutions and experts 


Algeria 

Centre de Recherche en Economie Appliquée, 
20 Rue Chalid Mustapha Khalif, Ben 
Alenoun, Algiers. 


Idir Khenniche 


Brazil 
Associação Brasilieira de Teleducagáo (ABT), 
Rua Campos da Paz 60, Rio Comprido, 
Fi Rio de Janeiro. 
inanciadora de Estudios e Projetos, Avenida 
Rio Branco 124/9°, Rio de Janeiro. 


J. M. de Macedo 
Costa 


João B. A. Oliveira 


Bulgaria 
Institut de Recherches Scientifiques sur Albert Avramov 
Pauline Micheva 


l'Éducation ‘Todor Samodoumov’, 
Boulevard Lénine, No. 125, Sofia. Violetta Mirtcheva 


Canada 

Ontario Institute for Studies in Education, 
252 Bloor Street West, Toronto, 
Ontario M5S 1V6. 
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Czechoslovakia ] . 
School of Engineering, Institute of Economics 
of Education, Bratislava. 


Finland Ae 
Institute for Educational Research, University 
of Jyvaskyla, 40100 Jyvaskyla ro. 


France 

Bureau d’Etudes Technico-Economiques 
Appliquées à Enseignement 
Audio-Visuel (BETEA), Voie des Pilotes, 
94360 Bry-sur-Marne. 

Institut National de l'Audio-Visuel (INA), 
Voie des Pilotes, 94360 Bry-sur-Marne. 

Institut de Recherche sur Économie de 
P Education (IREDU), Faculté Mirande, 
Campus Universitaire, 21000 Dijon. 

Centre Audio-Visuel de l’École Normale 
Supérieure de Saint-Cloud, Avenue du 
Palais, 92210 Saint-Cloud. 


Federal Republic of Germany 

Deutsches Institut für Fernstudien an der 
Universitat Tübingen (DIFF), 

7400 Tiibingen, Wordstrasse 8. 

Forschungs- und Entwicklungszentrum fiir 
objektivierte Lehr- und Lernverfahren 
GmbH, 4790 Paderborn I; 
Rathenaustrasse 69/71. 

Deutsches Institut fiir Internationale 
Padagogische Forschung, Abt. 
Bildungsókonomie (DIPF) 
6000 Frankfurt, Schlosstr 


, 
asse 27. 


Max Planck Institut für Bildungsforschung, 
1000 Berlin 33, Lenzenallee 94. 


Honduras 

Instituto de Investigaciones 
Socio-Economicas, Apartado 786, 
Tegucigalpa. 


Hungary 

Centre National de Technologie de 
l'Éducation, OOK, P.F. 93, 
1476 Budapest. 


Dogmar Liskova 


Pertti Keittunen 
Jarmo Reitti 
Kari Turtiainon 


Maurice Guillin 
Jacques Rubenach 


J.-C. Eicher, 
Directeur 

F. Orivel 

R. Lefranc, Directeur 
F. Mariet 


Walter Schneider 
Hermann Sigelen 


E. Steuer 
W. Tenfelde 


Manfred Weiss 


Peter Doring 


J. Naumann 


R. A. White 


Andras Rohonyi ` ` 
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Université Karl Marx, 
Faculté des Sciences Economiques, 
Budapest. 


India 
Institute of Economic Growth, New Delhi. 
National Council for Educational Research 
and Training (NCERT), Centre for 
Educational Technology, Sri Aurobindo 
Ashram, Sri Aurobindo Marg, 
New Delhi 110.116. 
Organization—SAC P.O., 
Ahmedabad 380 053. 


Indonesia 
Bandung Institute of Technology, Bandung. 


Israel 

Council for Higher Education, Planning and 
Grants Committee, P.O.B. 4037, 
Jerusalem. 


Ivory Coast 

Unité d'Évaluation, Ministére de 
PEnseignement Primaire et dela — 
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